Equipment connection method, electronic equipment and system

Abstract

The embodiment of the invention provides a device connection method, an electronic device and a system. The method comprises the following steps: when a first electronic device detects a first operation, acquiring a plurality of frames of images displayed by a second electronic device through a camera, determining digital watermark information hidden in the plurality of frames of images, determining device identification information of the second electronic device through the digital watermark information, and displaying the device identification information on the second electronic device. And further establishing a connection relationship with the second electronic equipment. According to the technical scheme, when equipment connection is carried out, the interaction path of equipment connection can be shortened, the process of equipment connection is simplified, and equipment connection is more convenient.

Description

Device connection method, electronic device, and system

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on April 14, 2023, with application number 202310444860.3 and invention name “Device connection method, electronic device and system”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] Embodiments of the present application relate to the field of electronic technology, and more particularly, to a device connection method, an electronic device, and a system. Background Art

[0003] Currently, users have more and more electronic devices, and there are often scenarios where electronic devices need to be connected. When connecting electronic devices, the interaction path is generally long and the steps are cumbersome.

[0004] Although using ultra wide band (UWB) technology to connect electronic devices can reduce the interaction path, it requires both electronic devices to deploy UWB chips, which increases the cost of the electronic devices.

[0005] Digital watermark technology has excellent concealment properties. When digital watermark technology is applied to establish device connections between electronic devices, when electronic device A superimposes device identification information on the displayed image in the form of a digital watermark, and another electronic device B uses a camera to capture the image displayed by electronic device A to identify electronic device A, the moiré pattern generated during the shooting process will make the digital watermark in the image displayed by electronic device A difficult to recognize.

[0006] Summary of the Invention

[0007] Embodiments of the present application provide a method, electronic device, and system for device connection. This technical solution allows a user to connect the first and second electronic devices by simply performing an operation to trigger the establishment of a device connection, scanning an image displayed by a second electronic device through the camera of the first electronic device, and identifying the device identification information in the image. This shortens the interaction path for device connection, simplifies the device connection process, and makes device connection more convenient.

[0008] In a first aspect, a system is provided, which includes a first electronic device and a second electronic device, wherein the second electronic device is used to hide and superimpose digital watermark information including device identification information of the second electronic device onto multiple frames of images displayed by the second electronic device; the first electronic device is used to obtain the multiple frames of images through a camera when a first operation is detected; the first electronic device is also used to determine the digital watermark information hidden in the multiple frames of images; the first electronic device is also used to determine the device identification information of the second electronic device through the digital watermark information; the first electronic device is also used to establish a connection relationship with the second electronic device based on the device identification information.

[0009] Based on the system provided in the embodiment of the present application, a user can complete the connection between the first electronic device and the second electronic device by scanning the image displayed by the second electronic device through the camera of the first electronic device and identifying the digital watermark information including the device identification information in the image, thereby shortening the interaction path of the device connection, simplifying the device connection process, and making the device connection more convenient.

[0010] In combination with the first aspect, in an implementation of the first aspect, the first electronic device is specifically used to: determine the key area of ​​the multi-frame image, the key area being the area in the multi-frame image whose texture complexity is greater than a first preset value; perform decoding operation on the key area of ​​the multi-frame image to obtain the digital watermark information.

[0011] Based on the embodiment of the present application, the first electronic device determines the device identification information of the second electronic device by determining a partial area of ​​the image, thereby eliminating the need to process the entire image and reducing the power consumption of the first electronic device.

[0012] In combination with the first aspect, in an implementation of the first aspect, the first electronic device is specifically used to: perform decoding operations on two adjacent frames of the multiple frames of images; and superimpose the operation results of multiple adjacent frames of images to obtain the digital watermark information.

[0013] Based on the embodiment of the present application, the first electronic device can superimpose the calculation results of multiple adjacent frames of images to make the digital watermark information finally obtained clearer, thereby increasing the possibility of the first electronic device accurately identifying the digital watermark information.

[0014] In combination with the first aspect, in an implementation of the first aspect, the digital watermark information is superimposed on each frame of the multiple images, and the ratio of the size of the digital watermark information to the size of the image is greater than a second preset value, wherein the first electronic device is specifically used to: perform decoding operations on the entire image of the multiple frames to obtain the digital watermark information.

[0015] For example, the second preset value may be 1, 0.9, etc.

[0016] According to the embodiment of the present application, since the digital watermark information is large in size, the user can use the camera of the first electronic device to obtain the digital watermark information at a greater distance from the second electronic device. Therefore, the first electronic device can establish a device connection from a distance from the second electronic device.

[0017] In a second aspect, a method for device connection is provided, which is applied to a first electronic device, including: detecting a first operation, obtaining multiple frames of images displayed by a second electronic device through a camera, wherein digital watermark information is hidden in the multiple frames of images, and the digital watermark information includes device identification information of the second electronic device; determining the digital watermark information hidden in the multiple frames of images; determining the device identification information of the second electronic device through the digital watermark information; and establishing a connection relationship with the second electronic device based on the device identification information.

[0018] Based on the embodiments of the present application, when detecting a first operation, the first electronic device can obtain multiple frames of images displayed by the second electronic device through a camera and determine the digital watermark information in the multiple frames of images; determine the device identification information of the second electronic device through the digital watermark information, and further establish a connection relationship with the second electronic device.

[0019] In this way, when connecting devices, the user only needs to perform the operation to trigger the establishment of the device connection, and then use the camera of the first electronic device to scan the image displayed by the second electronic device and identify the device identification information in the image to complete the connection between the first electronic device and the second electronic device. This can shorten the interaction path of the device connection, simplify the device connection process, and make device connection more convenient.

[0020] In combination with the second aspect, in an implementation of the second aspect, determining the digital watermark information hidden in the multi-frame images includes: determining a key area of ​​the multi-frame images, the key area being an area in the multi-frame images where the texture complexity is greater than a preset value; and determining the digital watermark information through the key area of ​​the multi-frame images.

[0021] Based on the embodiment of the present application, the first electronic device can determine the digital watermark information of the second electronic device by determining the key areas of multiple frames of images to determine the device identification information of the second electronic device.

[0022] In this way, the first electronic device determines the device identification information of the second electronic device by determining a partial area of ​​the image, thereby eliminating the need to process the entire image and reducing power consumption of the first electronic device.

[0023] In other embodiments, the first electronic device may also determine the digital watermark information of the second electronic device through the entire image of the multiple frames or a fixed area of ​​the multiple frames.

[0024] In combination with the first aspect, in an implementation of the first aspect, determining the digital watermark information through the key area of ​​the multiple frames of images includes: performing a decoding operation on the key area of ​​the multiple frames of images to obtain the digital watermark information.

[0025] For example, the digital watermark information may be a barcode, such as a two-dimensional barcode or a one-dimensional barcode. The digital watermark information may also be a website address or a digital number.

[0026] Based on the embodiment of the present application, the digital watermark information is superimposed on the key area of ​​the image. The first electronic device can perform decoding operations on the key area of ​​multiple frames of images to obtain the digital watermark information, and further obtain the device identification information of the second electronic device through the digital watermark information.

[0027] In this way, the digital watermark information of the second electronic device is superimposed on the key area of ​​the displayed image, so that the digital watermark information can be invisible or basically invisible to the user, thereby improving the concealment of the digital watermark information and allowing the second electronic device to normally display the image to be displayed, thereby not affecting the user's normal use of the second electronic device.

[0028] In combination with the first aspect, in an implementation of the first aspect, the decoding operation on the key area of ​​the multiple frames of images to obtain the digital watermark information includes: performing a decoding operation on the key areas of two adjacent frames of images of the multiple frames to obtain the digital watermark information.

[0029] Based on the embodiments of the present application, the first electronic device can perform decoding operations on the key areas of two adjacent frames of multiple images to obtain digital watermark information. This technical solution allows the first electronic device to obtain digital watermark information by processing the key areas of any two adjacent frames of images, thereby simplifying the implementation of the technical solution.

[0030] In combination with the first aspect, in an implementation of the first aspect, the decoding operation is performed on the key areas of the multiple frames of images to obtain the digital watermark information, including: performing a decoding operation on the key areas of two adjacent frames of images of the multiple frames of images; and superimposing the operation results of the key areas of multiple adjacent frames of images to obtain the digital watermark information.

[0031] Based on the embodiment of the present application, the first electronic device can superimpose the calculation results of the key areas of multiple adjacent frames of images to make the digital watermark information finally obtained clearer, thereby increasing the possibility of the first electronic device accurately identifying the digital watermark information.

[0032] In combination with the first aspect, in an implementation of the first aspect, the digital watermark information is superimposed on each frame of the multiple images, and the ratio of the size of the digital watermark information to the size of the image is greater than a second preset value, wherein determining the digital watermark information hidden in the multiple frames of images includes: performing a decoding operation on the entire image of the multiple frames to obtain the digital watermark information.

[0033] According to the embodiment of the present application, the ratio of the size of the digital watermark information to the size of the image is greater than the second preset value, and the digital watermark information is superimposed on each frame of the image, so that the size of the digital watermark information is larger, and the user can obtain the digital watermark information using the camera of the first electronic device at a greater distance from the second electronic device. Therefore, the first electronic device can establish a device connection from a distance from the second electronic device.

[0034] In combination with the first aspect, in an implementation of the first aspect, the decoding operation is performed on the entire image of the multiple frames to obtain the digital watermark information, including: performing a decoding operation on the entire image of two adjacent frames of the multiple frames to obtain the digital watermark information.

[0035] Based on the embodiments of the present application, the first electronic device can perform decoding operations on the entire image of two adjacent frames of the multi-frame image to obtain digital watermark information. This technical solution allows the first electronic device to obtain digital watermark information by processing any two adjacent frames of the image, thereby simplifying the implementation of the technical solution.

[0036] In combination with the first aspect, in an implementation of the first aspect, the decoding operation is performed on the entire image of the multiple frames to obtain the digital watermark information, including: performing a decoding operation on the entire image of two adjacent frames of the multiple frames; and superimposing the operation results of the entire images of multiple adjacent frames to obtain the digital watermark information.

[0037] Based on the embodiment of the present application, the first electronic device can superimpose the calculation results of the entire image of multiple adjacent frames of images to make the digital watermark information finally obtained clearer, thereby increasing the possibility of the first electronic device accurately identifying the digital watermark information.

[0038] In combination with the first aspect, in an implementation manner of the first aspect, the method further includes: sending first indication information to the second electronic device, where the first indication information is used to instruct the second electronic device to stop superimposing the digital watermark information onto the displayed image.

[0039] In an embodiment of the present application, the first electronic device may further send a first instruction message to at least one electronic device to instruct it to stop superimposing the digital watermark information on the displayed image. This technical solution can prevent the electronic device from continuously performing encoding operations, thereby reducing the power consumption of the electronic device.

[0040] In combination with the first aspect, in an implementation manner of the first aspect, the digital watermark information is a barcode.

[0041] In other embodiments, the digital watermark information may also be a website address or a digital number.

[0042] In combination with the first aspect, in an implementation of the first aspect, the device identification information includes at least one of a product serial number of the second electronic device, a MAC address of the second electronic device, or a digital number mapped to the product serial number.

[0043] In other embodiments, the device identification information may include, in addition to the above content, the model of the second electronic device, configuration information of the second electronic device, a device name, etc.

[0044] In a third aspect, a method for device connection is provided, which is applied to a second electronic device and includes: receiving second indication information sent by a first electronic device, the second indication information being used to instruct the second electronic device to superimpose device identification information onto a displayed image; hiding digital watermark information including the device identification information of the second electronic device onto the displayed image according to the second indication information, the digital watermark information being used to establish a connection relationship between the first electronic device and the second electronic device.

[0045] Based on the embodiment of the present application, after receiving the second indication information sent by the first electronic device, the second electronic device can superimpose digital watermark information including the device identification information of the second electronic device on the displayed image.

[0046] In this way, since the image displayed by the second electronic device includes digital watermark information, the digital watermark information includes the device identification information of the second electronic device, the first electronic device can directly scan the multiple frames of images displayed by the second electronic device when it needs to establish a device connection to obtain the device identification information therein, which is conducive to achieving convenient connection.

[0047] In combination with the third aspect, in an implementation method of the third aspect, the digital watermark information including the device identification information of the second electronic device is hidden and superimposed on the displayed image according to the second indication information, including: superimposing the digital watermark information on a key area of ​​the image according to the second indication information, the key area being an area in the image where the texture complexity is greater than a first preset value.

[0048] Based on the embodiments of the present application, the second electronic device can conceal the digital watermark information and overlay it on key areas of the displayed image based on the second indication information. This can render the digital watermark information invisible or substantially invisible, improving the concealment of the digital watermark information. It can also allow the second electronic device to display the desired image normally, without affecting the user's normal use of the second electronic device.

[0049] In combination with the third aspect, in an implementation method of the third aspect, the hiding and superimposing of the digital watermark information including the device identification information of the second electronic device onto the displayed image according to the second indication information includes: superimposing the digital watermark information on the entire image of the image according to the second indication information, wherein the ratio of the size of the digital watermark information to the size of the image is greater than a second preset value.

[0050] Based on the embodiments of the present application, the second electronic device can overlay the digital watermark information on the entire displayed image based on the second indication information. As a result, the digital watermark information is larger in size, and the user can use the camera of the first electronic device to obtain the digital watermark information at a greater distance from the second electronic device. This allows the first electronic device to establish a device connection from a greater distance from the second electronic device.

[0051] In combination with the third aspect, in an implementation of the third aspect, the method further includes: receiving first indication information sent by the first electronic device; and stopping hiding and superimposing the digital watermark information on the displayed image according to the first indication information.

[0052] Based on the embodiment of the present application, the second electronic device can also receive the first instruction information sent by the first electronic device and stop superimposing the digital watermark information on the displayed image according to the first instruction information. This technical solution can prevent the second electronic device from continuously performing the encoding operation, thereby reducing the power consumption of the second electronic device.

[0053] In combination with the third aspect, in an implementation manner of the third aspect, the digital watermark information is a barcode.

[0054] In combination with the third aspect, in an implementation of the third aspect, the device identification information includes at least one of a product serial number of the second electronic device, a MAC address of the second electronic device, or a digital number mapped to the product serial number.

[0055] In a fourth aspect, an electronic device is provided, comprising: one or more processors; one or more memories; the one or more memories storing one or more programs, which, when executed by the one or more processors, enable the method for connecting a device as described in the second aspect and any possible implementation thereof to be executed.

[0056] In a fifth aspect, an electronic device is provided, comprising: one or more processors; one or more memories; the one or more memories storing one or more programs, which, when executed by the one or more processors, enable the method for connecting a device as described in the third aspect and any possible implementation thereof to be executed.

[0057] In the sixth aspect, a chip is provided, which includes a processor and a communication interface, wherein the communication interface is used to receive a signal and transmit the signal to the processor, and the processor processes the signal so that the device connection method described in the second aspect and any possible implementation thereof is executed.

[0058] In the seventh aspect, a chip is provided, which includes a processor and a communication interface, wherein the communication interface is used to receive a signal and transmit the signal to the processor, and the processor processes the signal so that the device connection method described in the third aspect and any possible implementation thereof is executed.

[0059] In an eighth aspect, a readable storage medium is provided, wherein the readable storage medium stores instructions. When the instructions are executed on a device, the device connection method as described in the second aspect and any possible implementation thereof is executed.

[0060] In a ninth aspect, a readable storage medium is provided, wherein instructions are stored in the readable storage medium. When the instructions are executed on a device, the device connection method as described in the third aspect and any possible implementation thereof is executed.

[0061] In a tenth aspect, a program product is provided, comprising a program code. When the program code is run on an electronic device, the device connection method as described in the second aspect and any possible implementation thereof is executed.

[0062] In an eleventh aspect, a program product is provided, comprising a program code, which, when executed on an electronic device, enables the device connection method as described in the third aspect and any possible implementation thereof to be executed. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] FIG1 is a schematic structural diagram of an electronic device provided in an embodiment of the present application.

[0064] FIG2 is a schematic diagram of the software structure of the electronic device provided in an embodiment of the present application.

[0065] FIG3 is a schematic diagram of a scenario to which the embodiments of the present application may be applied.

[0066] FIG4 is a schematic diagram of an inter-frame encoding method of an image provided in an embodiment of the present application.

[0067] FIG5 is a schematic diagram of another inter-frame encoding method of an image provided in an embodiment of the present application.

[0068] FIG6 is a schematic diagram of another inter-frame encoding method of an image provided in an embodiment of the present application.

[0069] FIG7 is a schematic diagram of decoding an image provided by an embodiment of the present application.

[0070] FIG8 is a schematic diagram of superimposing multiple two-dimensional barcodes provided in an embodiment of the present application.

[0071] FIG9 is a schematic interaction diagram of a device connection method provided in an embodiment of the present application.

[0072] FIG10 is a schematic block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0073] The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.

[0074] The device connection method in the embodiments of the present application can be applied to electronic devices such as smartphones, monitors, smart TVs, tablet computers, laptops, personal computers (PCs), ultra-mobile personal computers (UMPCs), netbooks, vehicle-mounted devices, wearable devices, foldable devices, and Internet of Things (IoT) devices with display screens.

[0075] 1 shows a schematic diagram of the structure of an electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0076] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0077] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0078] In this application, the processor 110 can be used to encode and decode images. For example, the processor 110 in one electronic device can be used to overlay device identification information onto a displayed image. The processor in another electronic device can be used to identify the device identification information from a captured image.

[0079] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0080] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0081] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus interface.

[0082] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL).

[0083] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170.

[0084] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface.

[0085] The UART interface is a universal serial data bus used for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160.

[0086] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193.

[0087] The GPIO interface can be configured via software. The GPIO interface can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc.

[0088] The USB interface 130 is an interface that complies with USB standards, and may be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 may be used to connect a charger to charge the electronic device 100, and may also be used to transfer data between the electronic device 100 and peripheral devices.

[0089] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0090] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the electronic device via the power management module 141.

[0091] The power management module 141 is used to connect the battery 142 , the charging management module 140 and the processor 110 .

[0092] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0093] The mobile communication module 150 can provide wireless communication solutions including 2G / 3G / 4G / 5G applied on the electronic device 100.

[0094] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0095] The wireless communication module 160 can provide wireless communication solutions for application on the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), Bluetooth low energy (BLE), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc.

[0096] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150 , and antenna 2 is coupled to wireless communication module 160 , so that electronic device 100 can communicate with the network and other devices through wireless communication technology.

[0097] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0098] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), or a display panel made of one of the following materials: organic light-emitting diode (OLED), active-matrix organic light-emitting diode (AMOLED), flexible light-emitting diode (FLED), MiniLED, MicroLed, Micro-oLed, or quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 can include one or N display screens 194, where N is a positive integer greater than 1.

[0099] In the embodiment of the present application, the electronic device 100 can display an image through the display screen 194, and display an image superimposed with digital watermark information.

[0100] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0101] The ISP is used to process data fed back by the camera 193. The camera 193 is used to capture still images or videos. In this application, the camera 193 can be used to obtain an image displayed on a display screen of another electronic device.

[0102] Digital signal processors are used to process digital signals. In addition to processing digital image signals, they can also process other digital signals.

[0103] The video codec is used to compress or decompress digital video. The electronic device 100 may support one or more video codecs.

[0104] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100.

[0105] The internal memory 121 may be used to store computer executable program codes, which include instructions. The processor 110 executes the instructions stored in the internal memory 121 to execute various functional applications and data processing of the electronic device 100.

[0106] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0107] The audio module 170 is used to convert digital audio information into analog audio signals for output, and is also used to convert analog audio input into digital audio signals.

[0108] The speaker 170A, also called a "horn", is used to convert audio electrical signals into sound signals.

[0109] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals.

[0110] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.

[0111] The headphone jack 170D is used to connect a wired headphone.

[0112] The pressure sensor 180A is used to sense pressure signals and convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194 .

[0113] The gyro sensor 180B may be used to determine the motion posture of the electronic device 100 .

[0114] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude using the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.

[0115] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes).

[0116] The distance sensor 180F is used to measure distance.

[0117] The fingerprint sensor 180H is used to collect fingerprints.

[0118] The touch sensor 180K is also called a “touch panel.” The touch sensor 180K can be disposed on the display screen 194 . The touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen.”

[0119] Bone conduction sensor 180M can acquire vibration signals. In some embodiments, bone conduction sensor 180M can acquire vibration signals from vibrating bones in the human body. Bone conduction sensor 180M can also contact the human pulse to receive blood pressure signals.

[0120] The buttons 190 include a power button, a volume button, and the like.

[0121] Motor 191 can generate vibration prompts.

[0122] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.

[0123] The SIM card interface 195 is used to connect a SIM card.

[0124] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present application, the software structure of the electronic device 100 is exemplified by taking an operating system of a layered architecture as an example.

[0125] Figure 2 is a block diagram of the software structure of electronic device 100 according to an embodiment of the present application. A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other via software interfaces. In some embodiments, the operating system is divided into four layers: the application layer, the application framework layer, the system library layer, and the kernel layer, from top to bottom. The application layer may include a series of application packages.

[0126] As shown in FIG2 , the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, wallet, etc.

[0127] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0128] As shown in FIG2 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

[0129] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0130] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0131] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0132] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).

[0133] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0134] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0135] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the core library.

[0136] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0137] The system library can include multiple functional modules, such as a surface manager, media libraries, a 3D graphics processing library (such as OpenGL ES), and a 2D graphics engine (such as SGL).

[0138] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0139] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0140] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0141] A 2D graphics engine is a drawing engine for 2D drawings.

[0142] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0143] Before introducing the technical solution of the present application, some professional terms that may be involved in the embodiments of the present application are briefly introduced as follows.

[0144] A digital watermark is a process of embedding specific information into a digital signal, such as audio, images, or video. Digital watermarks can be categorized as either emergent or covert. An emergent watermark is a visible watermark whose information is visible when viewing the image or video. A covert watermark is a digital data embedded in the audio, image, or video, but is generally invisible. The digital watermarks used in this application may be covert watermarks.

[0145] Currently, users have more and more electronic devices, and there are often scenarios where electronic devices need to be connected. When connecting electronic devices, the interaction path is generally long and the steps are cumbersome.

[0146] Although using UWB technology to connect electronic devices can reduce the interaction path, it requires both electronic devices to deploy UWB chips, which increases the cost of the electronic devices.

[0147] Hidden digital watermarking technology is highly concealable. Normally, hidden digital watermark information is added to an image displayed by an electronic device and the watermark is obtained by image processing. However, when the image is captured using the electronic device's camera, moiré patterns generated during the capture process make the watermark difficult to discern.

[0148] For example, digital watermark technology is applied to establish a connection relationship between devices. When electronic device A superimposes device identification information on the displayed image in the form of a digital watermark, and another electronic device B uses a camera to shoot the image displayed by electronic device A to identify the digital watermark information, the moiré pattern generated during the shooting process will make the digital watermark in the image displayed by electronic device A difficult to identify.

[0149] In view of this, embodiments of the present application provide a device connection method, electronic device, and system. In this technical solution, electronic device A can encode digital watermark information including device identification information to superimpose it on the displayed image, and this digital watermark information is invisible to the user; another electronic device B can capture multiple frames of images displayed by electronic device A through a camera, and obtain the digital watermark information in the multiple frames through decoding operations to obtain the device identification information of electronic device A; and further establish a connection relationship with electronic device A.

[0150] This technical solution allows electronic devices A and B to be connected. After executing the operation to trigger the establishment of the device connection, the user only needs to scan the image displayed by electronic device A through the camera of electronic device B and identify the digital watermark information including the device identification information in the image to complete the connection between electronic devices A and B. This can shorten the interaction path of the device connection, simplify the device connection process, and make the device connection more convenient.

[0151] For example, Figure 3 is a schematic diagram of a scenario to which the embodiments of the present application may be applied. As shown in Figure 3, a connection relationship between a mobile phone 200f and other electronic devices is established as an example for explanation.

[0152] 3 , a user's home may include electronic devices such as a smart TV 200 a , a smart TV 200 b , a smart TV 200 c , a PC 200 d , and a tablet 200 e .

[0153] When a user wishes to connect a mobile phone 200f to a smart TV 200c among multiple electronic devices in a home, the user can use the camera of the mobile phone 200f to scan or capture the image displayed by the smart TV 200c and recognize the digital watermark information therein, which may include the device identification information of the smart TV 200c. Thus, the mobile phone 200f can establish a connection with the smart TV 200c.

[0154] In one example, when mobile phone 200f detects a first operation triggering a device connection, mobile phone 200f can send an instruction message to other electronic devices in the home. The electronic devices that receive the instruction message can overlay digital watermark information including their device identification information onto the displayed image, and this digital watermark information is invisible to the user. If the user wishes to establish a connection between mobile phone 200f and smart TV 200c, they can use the camera of mobile phone 200f to scan or capture the image displayed by smart TV 200c, identify the digital watermark information therein, and obtain the device identification information of smart TV 200c from the digital watermark information. After that, mobile phone 200f can establish a connection with smart TV 200c.

[0155] Thus, when connecting mobile phone 200f to smart TV 200c, the user only needs to perform a first operation and then scan the image displayed on smart TV 200c using the camera of mobile phone 200f to complete the connection. This technical solution can shorten the interaction path for device connection, simplify the device connection process, and make device connection more convenient. In addition, this technical solution does not require adding new hardware to the electronic device.

[0156] Since other electronic devices will perform the operation of superimposing the device identification information on the displayed image after receiving the instruction information, if other electronic devices continue to perform the above operation, the power consumption of the electronic devices will be increased. In order to reduce the power consumption of electronic devices, in some optional embodiments, the mobile phone 200f can also send a first instruction information to other electronic devices, and the first instruction information can be used to instruct other electronic devices to stop superimposing the device identification information on the displayed image. In this way, after receiving the first instruction information, other electronic devices can resume the normal display of the image without continuing to superimpose the device identification information on the displayed image. This can save the power consumption of electronic devices to a certain extent.

[0157] In another example, when other electronic devices in the home display images, they can always hide and superimpose digital watermark information including their device identification information on the displayed image, and the digital watermark information is invisible to the user; when the mobile phone 200f detects the first operation, the camera can be turned on; and the image displayed by the smart TV 200c can be scanned or photographed through the camera to identify the digital watermark information therein; and the device identification information of the smart TV 200c can be obtained through the digital watermark information; thereafter, the mobile phone 200f can establish a connection relationship with the smart TV 200c.

[0158] It should be understood that when an electronic device conceals and superimposes a digital watermark on a displayed image, the digital watermark information can be understood as being invisible or substantially invisible to the user. Alternatively, it can be understood that the user cannot see or recognize the digital watermark information when viewing the image directly with the naked eye without the aid of other devices.

[0159] For example, an electronic device can superimpose digital watermark information on a key area in a displayed image, where the texture complexity of the key area is high, so that the digital watermark information can be well hidden in the key area of ​​the image, making the digital watermark information invisible to the user.

[0160] For another example, when an electronic device superimposes digital watermark information on a displayed image, it can superimpose the digital watermark information on two adjacent frames of the image. For example, in the Tth frame, the brightness value of the pixel of the digital watermark information increases slightly, and the increased brightness value is less than a threshold. In this case, the human eye can not distinguish between the image and the digital watermark information. In the Tth frame, the brightness value of the pixel of the digital watermark information decreases slightly, and the decreased brightness value is the same as the increased brightness value in the Tth frame. In this way, the digital watermark information can be better concealed, invisible or almost invisible to the user.

[0161] In this way, since the image normally displayed by the smart TV 200c always includes its device identification information, the mobile phone 200f can scan the image displayed by the smart TV 200c at any time. The user can use the mobile phone 200f to scan or shoot the image displayed by the smart TV 200c at any time to connect the device, thereby improving the efficiency of device connection and user experience.

[0162] The first operation may be an operation of clicking the scan sub-function in a camera application; or, the first operation may be an operation of the user sliding from a fixed area of ​​the display screen of the first electronic device, for example, the first operation is an operation of the user sliding along a certain angle starting from a corner of the display screen; or, there is a shortcut function button in the control center of the drop-down menu bar of the first electronic device, and the first operation may be an operation of the user clicking the function button.

[0163] For example, the device identification information may include one or more of the following information: the device's product serial number, media access control (MAC) address, device model information, device name, or device configuration information. Alternatively, the device identification information may be a mapping of the above information. For example, since the device's product serial number is generally 15 digits, in order to reduce encoding overhead, the device identification information may also be a mapping of the device's product serial number, for example, mapping the device's product serial number into a 6-digit or 8-digit number.

[0164] For example, let's take the example of establishing a Bluetooth connection between a mobile phone 200f and a smart TV 200c. When the device identification information includes the device's product serial number, MAC address, or device name, after the mobile phone 200f obtains the digital watermark information of the smart TV 200c, it can obtain the product serial number, MAC address, or device name of the smart TV 200c from the digital watermark information. At this point, the smart TV 200c can broadcast a Bluetooth message that carries the device identification information of the smart TV 200c. Thus, the mobile phone 200f can scan the Bluetooth message from the smart TV 200c and, based on the obtained device identification information, determine that the device to be connected is the smart TV 200c. Thus, the mobile phone 200f can perform Bluetooth pairing with the smart TV 200c to establish a Bluetooth communication connection.

[0165] Alternatively, when the mobile phone 200f and the smart TV 200c are in the same local area network or logged in to the same Huawei account, and the device identification information is the product serial number or MAC address of the device, after the mobile phone 200f obtains the digital watermark information of the smart TV 200c, the product serial number or MAC address of the smart TV 200c can be obtained from the digital watermark information, so that the mobile phone 200f can establish a connection relationship with the smart TV 200c.

[0166] Alternatively, when the mobile phone 200f and the smart TV 200c are in the same local area network or logged in to the same Huawei account, when the device identification information is a digital number mapped to the product serial number of the smart TV, after the mobile phone 200f obtains the digital watermark information of the smart TV 200c, it can obtain the digital number mapped to the product serial number of the smart TV 200c from the digital watermark information, and further identify the smart TV 200c based on the digital number, so that the mobile phone 200f can establish a connection relationship with the smart TV 200c.

[0167] The digital watermark information may be a barcode (eg, a one-dimensional barcode or a two-dimensional barcode, etc.), or a website address or a digital number, etc. The embodiment of the present application does not limit the specific form of the digital watermark information.

[0168] It should be understood that after the mobile phone 200f establishes a connection with the smart TV 200c, the mobile phone 200f can transmit data to the smart TV 200c; or, the user can control the smart TV 200c through the mobile phone 200f; or, the mobile phone 200f can cast the screen to the smart TV 200c, etc., which is not limited in the embodiments of the present application.

[0169] The technical solution for an electronic device to superimpose digital watermark information including its device identification information onto a displayed image, and the digital watermark information is invisible to the user, can be described as follows. The embodiment of the present application takes the digital watermark information as a two-dimensional barcode as an example for description.

[0170] Method 1: The electronic device may superimpose a two-dimensional barcode on a key area of ​​the displayed image, where the key area is an area with high texture complexity in the image.

[0171] Method 2: The electronic device may superimpose a two-dimensional barcode on the displayed image, wherein the ratio of the size of the two-dimensional barcode to the size of the image is greater than a threshold.

[0172] Method three: The electronic device may superimpose multiple two-dimensional barcodes on the displayed image in a matrix arrangement, wherein the ratio of the sum of the sizes of the multiple two-dimensional barcodes to the size of the image is greater than a threshold.

[0173] Method 4: The electronic device can superimpose multiple two-dimensional barcodes at random positions on the displayed image.

[0174] Specifically, in the first approach, when the electronic device superimposes the two-dimensional barcode on the key area of ​​the displayed image, it may first determine the key area.

[0175] For example, the electronic device can divide the displayed image into N areas, calculate the texture complexity of the image content in each area, select the top k areas with large texture complexity as key areas, and superimpose the two-dimensional barcode on the key areas of the image.

[0176] It is understandable that the electronic device can determine the texture complexity of each region by calculating the color histogram of each region, or the local binary pattern (LBP) texture feature, or the edge detection feature, or the second-order moment of the grayscale histogram of the image.

[0177] For example, refer to FIG4 , which is a schematic diagram of an inter-frame encoding method of an image provided in an embodiment of the present application.

[0178] Under normal circumstances, the display screen of an electronic device will display images frame by frame. For example, if the refresh rate of the display screen of an electronic device is 60 Hz, it means that the display screen can display 60 frames of images per second.

[0179] The electronic device may superimpose the two-dimensional barcode on two adjacent frames of displayed images. It should be understood that the process of the electronic device superimposing the two-dimensional barcode on two adjacent frames of displayed images may be referred to as encoding operation.

[0180] 4 , the area with a “+” sign in the image indicates that the brightness of the pixels of the two-dimensional barcode in the area is increased, and the area with a “-” sign indicates that the brightness of the pixels of the two-dimensional barcode in the area is decreased, and the value of the increased brightness is the same as the value of the decreased brightness.

[0181] After the electronic device determines the key area of ​​the displayed image, as shown in FIG4 , for the T-th frame image, the pixels of the two-dimensional barcode can be increased in brightness and superimposed on the pixels of the key area of ​​the T-th frame image. For the T+1-th frame image, the pixels of the two-dimensional barcode superimposed on the T-th frame can be inverted (reduced in brightness) and superimposed on the pixels of the key area of ​​the T+1-th frame image, wherein the position of the two-dimensional barcode in the T-th frame image is the same as its position in the T+1-th frame image. For example, if the brightness of the pixels of the two-dimensional barcode in the T-th frame image is increased by 1.1 times the original brightness, then the brightness of the pixels of the two-dimensional barcode in the T+1-th frame image is decreased by -1.1 times the original brightness.

[0182] For the T+2th frame image, the same operation as for the Tth frame image can be performed. For the T+3th frame image, the same operation as for the T+1th frame image can be performed. And so on.

[0183] From the above description, it can be seen that in the image displayed by the electronic device, the brightness of the two-dimensional barcode in the key area in two adjacent frames of image is opposite. By subtracting two consecutive frames of image, a two-dimensional barcode that does not contain the original image can be obtained, thereby further determining the device identification information of the electronic device.

[0184] In this way, after the two-dimensional barcode including its device identification information is superimposed on the image displayed by the electronic device, since the two-dimensional barcode is superimposed on the key area with high texture complexity, it can be invisible or basically invisible to the user, thereby improving the concealment of the two-dimensional barcode and allowing the electronic device to normally display the image to be displayed, thereby not affecting the user's normal use of the electronic device.

[0185] Optionally, the electronic device may also superimpose a two-dimensional barcode on a fixed position of the displayed image, for example, the two-dimensional barcode is located in the lower left corner or lower right corner of the image.

[0186] In the second method, the electronic device may superimpose a two-dimensional barcode whose size ratio to the size of the displayed image is greater than a threshold value onto the displayed image. For example, the threshold value may be 1 or 0.9.

[0187] For example, refer to FIG5 , which is a schematic diagram of another inter-frame encoding method of an image provided in an embodiment of the present application.

[0188] It should be understood that the areas with “+” and “-” signs in FIG. 5 can refer to the relevant descriptions in the foregoing text.

[0189] For the T-th frame image in Figure 5, the pixels of the 2D barcode can be brightened and superimposed on the pixels of the T-th frame image. For the T+1-th frame image, the pixels of the 2D barcode superimposed on the T-th frame can be inverted (brightened) and superimposed on the pixels of the T+1-th frame image. For example, if the brightness of the pixels of the 2D barcode in the T-th frame image is increased by 1.2 times the original brightness, then the brightness of the pixels of the 2D barcode in the T+1-th frame image can be reduced by -1.2 times the original brightness.

[0190] For the T+2th frame image, the same operation as for the Tth frame image can be performed. For the T+3th frame image, the same operation as for the T+1th frame image can be performed. And so on.

[0191] From the above description, it can be seen that in the image displayed by the electronic device, the brightness of the two-dimensional barcodes in two adjacent frames of images is opposite. By subtracting two consecutive frames of images, a two-dimensional barcode that does not contain the original image can be obtained, thereby further determining the device identification information of the electronic device.

[0192] In this way, due to the large size of the two-dimensional barcode, the user can obtain the two-dimensional barcode through the camera of another electronic device at a farther distance from the electronic device, so that the two electronic devices can establish a connection relationship at a farther distance.

[0193] Optionally, the length of the two-dimensional barcode may also be the same as the length of the image displayed by the electronic device, or the width of the two-dimensional barcode may also be the same as the width of the image displayed by the electronic device, which is not limited in the embodiment of the present application.

[0194] In method three, the electronic device may superimpose multiple two-dimensional barcodes on the displayed image in a matrix arrangement, wherein the ratio of the sum of the sizes of the multiple two-dimensional barcodes to the size of the image is greater than a threshold value, for example, the threshold value may be 1 or 0.9.

[0195] For example, FIG6 is a schematic diagram of another inter-frame encoding method of an image provided in an embodiment of the present application.

[0196] 6 , the electronic device may superimpose four two-dimensional barcodes on the displayed image in a 2*2 matrix arrangement. The sum of the sizes of the four two-dimensional barcodes may be the same as the size of the image displayed by the electronic device.

[0197] For the T-th frame image in Figure 6, the pixels of the two-dimensional barcode can be increased in brightness and superimposed on the pixels in the upper left and lower right corner areas of the T-th frame image. The pixels of the two-dimensional barcode superimposed on the pixels in the upper left and lower right corner areas of the T-th frame can be inverted (reduced in brightness) and superimposed on the pixels in the lower left and upper right corner areas of the T-th frame image. For the T+1-th frame image, the pixels of the four two-dimensional barcodes superimposed on the T-th frame image can be inverted and superimposed on the pixels at corresponding positions in the T+1-th frame image.

[0198] For the T+2th frame image, the same operation as for the Tth frame image can be performed. For the T+3th frame image, the same operation as for the T+1th frame image can be performed. And so on.

[0199] From the above description, it can be seen that in the image displayed by the electronic device, the brightness of the two-dimensional barcodes in two adjacent frames of images is opposite. By subtracting two consecutive frames of images, a two-dimensional barcode that does not contain the original image can be obtained, thereby further determining the device identification information of the electronic device.

[0200] In this way, since multiple two-dimensional barcodes can be superimposed on the image displayed by the electronic device, other electronic devices can more easily obtain the two-dimensional barcode through the image, thereby improving the speed of device connection.

[0201] In the fourth method, the electronic device may superimpose multiple two-dimensional barcodes at random positions of the displayed image.

[0202] For example, for the Tth frame image, the electronic device may increase the brightness of the pixels of the three two-dimensional barcodes and overlay them on pixels in a random area of ​​the Tth frame image. For the T+1th frame image, the electronic device may invert the brightness of the three two-dimensional barcodes overlaid on the pixels of the Tth frame image and overlay them on the corresponding positions of the T+1th frame image. The same operation may be performed on the T+2th frame image. The same operation may be performed on the T+3th frame image as on the T+1th frame image. And so on.

[0203] Optionally, in the above-mentioned methods 1 to 4, several frames of images may be included between the T-th frame image and the T+1-th frame image; or several frames of images may be included between the T+1-th frame image and the T+2-th frame image; or several frames of images may be included between the T+2-th frame image and the T+3-th frame image, which are not limited in the embodiments of the present application. In this case, the encoding overhead of the electronic device can be reduced, and the power consumption of the electronic device can be reduced.

[0204] The decoding process of another electronic device is described by taking the above-mentioned method 3 in which the electronic device superimposes multiple two-dimensional barcodes onto the displayed image as an example.

[0205] Referring to Figure 7, Figure 7 is a schematic diagram of an image decoding method provided by an embodiment of the present application. Another electronic device can obtain a two-dimensional barcode without the image by subtracting the T+1 frame image from the T frame image, thereby determining the corresponding device identification information and, in turn, the corresponding electronic device. It should be understood that the other electronic device may include a decoding module capable of performing the above-described operations.

[0206] In some cases, if the electronic device performs the above decoding operation on adjacent frames T and T+1 of the acquired image, the resulting two-dimensional barcode is weak and may be unable to be recognized. The electronic device can then perform the above decoding operation on every two frames of the acquired multi-frame image to superimpose multiple identical two-dimensional barcodes, increasing the likelihood that the electronic device can accurately recognize the two-dimensional barcode. This technical solution is described below in conjunction with Figure 7.

[0207] For example, Figure 8 is a schematic diagram of a method for superimposing multiple two-dimensional barcodes, as provided in an embodiment of the present application. As shown in Figure 8, an electronic device can obtain two-dimensional barcode 1 by subtracting the T+1 frame image from the T frame image; the electronic device can obtain two-dimensional barcode 2 by subtracting the T+3 frame image from the T+2 frame image; and the electronic device can superimpose two-dimensional barcode 1 and two-dimensional barcode 2 to obtain two-dimensional barcode 3. Two-dimensional barcode 3 is a superposition of two two-dimensional barcodes, thereby increasing the likelihood that the electronic device can accurately identify two-dimensional barcode 3.

[0208] It is understandable that the electronic device can also use the above method to superimpose a larger number of two-dimensional barcodes, and the embodiments of the present application are not limited to this.

[0209] In the above embodiment, the digital watermark information is a two-dimensional barcode, and the device identification information is carried in the two-dimensional barcode as an example for description, but this should not limit the present application in any way. In other embodiments, the device identification information can also be carried in a one-dimensional barcode or a link. In other embodiments, the two-dimensional barcode can also include other device information, such as a device introduction, a purchase link, etc.

[0210] In other embodiments, the two-dimensional barcode can also be used as a normal two-dimensional barcode, not just for device connection. For example, the two-dimensional barcode can include a link to a product, and when a user scans the image containing the two-dimensional barcode with an electronic device, they can jump to the purchase reservation or purchase details page of the product.

[0211] FIG9 is a schematic interaction diagram of a device connection method provided by an embodiment of the present application. As shown in FIG9 , the method 800 can be applied to an electronic device, and the method 800 can include steps 810 to 850.

[0212] 810. When displaying an image, the second electronic device hides and superimposes digital watermark information including device identification information of the second electronic device on the displayed image.

[0213] In some implementations, the second electronic device can overlay the digital watermark information on key areas of the image, where the texture complexity of the image is greater than a first preset value. This technical solution can render the digital watermark information invisible or substantially invisible, improving the concealment of the digital watermark information. It can also allow the second electronic device to display the desired image normally, thereby not affecting the user's normal use of the second electronic device.

[0214] The technical solution for determining the key area by the second electronic device can be found in the relevant description above.

[0215] In some implementations, if the ratio of the size of the digital watermark information to the size of the image is greater than a second preset value, the second electronic device may overlay the digital watermark information onto the entire image. For example, the second preset value may be 0.7, 0.9, or 1, so that the size of the digital watermark information is larger, allowing the user to capture the digital watermark information using the camera of the first electronic device at a greater distance from the second electronic device. This allows the first electronic device to establish a device connection from a greater distance from the second electronic device.

[0216] In another possible implementation, the second electronic device may also superimpose the digital watermark information on a fixed position of the image, for example, the lower left corner or the lower right corner.

[0217] In another possible implementation, the second electronic device may also superimpose multiple identical digital watermark information onto the image in a matrix arrangement.

[0218] In another possible implementation, the second electronic device may also superimpose digital watermark information into a random position of the image.

[0219] 820. The first electronic device detects a first operation and obtains multiple frames of images displayed by the second electronic device through a camera.

[0220] Optionally, the first electronic device and the second electronic device may be in the same local area network, or the first electronic device and the second electronic device may log in to the same account (such as a Huawei account).

[0221] The first operation may be an operation that triggers the first electronic device to perform a device connection. For example, the first operation may be an operation of clicking the scan sub-function in a camera application; or the first operation may be an operation of a user sliding from a fixed area of ​​the display screen of the first electronic device, for example, the first operation is an operation of the user sliding from a corner of the display screen at a certain angle; or, the control center of the drop-down menu bar of the first electronic device includes a shortcut function button, and the first operation may be an operation of the user clicking the function button; or, the lock screen interface of the first electronic device includes a shortcut button, and the first operation may be an operation of the user clicking the shortcut button.

[0222] 830. The first electronic device determines the digital watermark information hidden in the multiple frames of images.

[0223] In one possible implementation, the first electronic device can determine key regions in multiple image frames, where the texture complexity of the multiple image frames exceeds a first preset value. The digital watermark information is then determined based on the key regions in the multiple image frames. This allows the first electronic device to determine the device identification information of the second electronic device by determining a portion of the image, eliminating the need to process the entire image and reducing power consumption.

[0224] In one possible implementation, digital watermark information is superimposed on each frame of the multi-frame image, and the ratio of the size of the digital watermark information to the size of the image is greater than a second preset value. The first electronic device can then perform a decoding operation on the entire multi-frame image to obtain the digital watermark information. For example, the second preset value can be 1, 0.9, or 0.8. In this way, due to the larger size of the digital watermark information, the user can use the camera of the first electronic device to obtain the digital watermark information at a greater distance from the second electronic device. This allows the first electronic device to establish a device connection from a greater distance from the second electronic device.

[0225] 840. The first electronic device determines device identification information of the second electronic device through the digital watermark information.

[0226] After acquiring the digital watermark information, the first electronic device may decode the digital watermark information to acquire the device identification information of the second electronic device.

[0227] 850. The first electronic device establishes a connection with the second electronic device according to the device identification information.

[0228] The first electronic device can determine the second electronic device based on the acquired device identification information and further establish a connection relationship with the second electronic device. It should be understood that the technical solution for establishing a connection relationship between the first electronic device and the second electronic device can refer to the relevant description above.

[0229] In one embodiment of the present application, when detecting the first operation, the first electronic device can obtain multiple frames of images displayed by the second electronic device through a camera, and determine the digital watermark information in the multiple frames of images to determine the device identification information of the second electronic device, and further establish a connection relationship with the second electronic device.

[0230] In this way, when connecting devices, the user only needs to perform the operation to trigger the establishment of the device connection, and then use the camera of the first electronic device to scan the image displayed by the second electronic device and identify the device identification information in the image to complete the connection between the first electronic device and the second electronic device. This can shorten the interaction path of the device connection, simplify the device connection process, and make device connection more convenient.

[0231] Optionally, upon detecting the first operation, the first electronic device may send a second instruction message to the second electronic device, where the second instruction message may be used to instruct the second electronic device to superimpose device identification information onto the displayed image. In this case, upon receiving the second instruction message, the second electronic device may conceal digital watermark information including the device identification information of the second electronic device and superimpose it onto the displayed image. The first electronic device then acquires multiple frames of images displayed by the second electronic device through the camera and continues to execute steps 830 to 850.

[0232] In this way, the second electronic device can perform the operation of superimposing the digital watermark information on the displayed image after the user performs the first operation, thereby performing the above operation when the user needs it, without having to continuously encode the image. This technical solution can improve the efficiency of device connection while further saving the power consumption of the second electronic device.

[0233] In some embodiments, the first electronic device determines digital watermark information hidden in multiple frames of images, including:

[0234] The first electronic device determines a key area of ​​the multi-frame image, where the key area is an area in the multi-frame image where the texture complexity is greater than a first preset value;

[0235] The first electronic device determines the digital watermark information of the second electronic device through the key areas of the multiple frames of images.

[0236] 4 , the key area may be the key area in the Tth frame image and the key area in the T+1th frame image. It should be understood that the first electronic device may determine the key area of ​​the multiple frames in the same manner as the second electronic device determines the key area.

[0237] In one embodiment of the present application, the first electronic device may determine the digital watermark information by determining the key areas of multiple frames of images, and further determine the device identification information of the second electronic device.

[0238] In this way, the first electronic device determines the digital watermark information by determining a partial area of ​​the image, thereby eliminating the need to process the entire image and reducing power consumption of the first electronic device.

[0239] In other embodiments, when the digital watermark information of the second electronic device is superimposed on the entire image or a fixed area of ​​the image, the first electronic device can also determine the device identification information of the second electronic device through the entire image of multiple frames or the fixed area of ​​multiple frames. The embodiments of the present application are not limited to this.

[0240] In some embodiments, determining digital watermark information based on key areas of multiple frames of images includes:

[0241] The first electronic device performs decoding operation on the key areas of the multiple frames of images to obtain digital watermark information.

[0242] For example, the digital watermark information may be a barcode, such as a two-dimensional barcode or a one-dimensional barcode. The digital watermark information may also be a website address or a digital number.

[0243] In one embodiment of the present application, the first electronic device may perform decoding operations on key areas of multiple frames of images to obtain digital watermark information, and further obtain device identification information of the second electronic device through the digital watermark information.

[0244] In this way, the digital watermark information of the second electronic device is superimposed on the key area of ​​the displayed image, so that the digital watermark information can be invisible or basically invisible to the user, thereby improving the concealment of the digital watermark information and allowing the second electronic device to normally display the image to be displayed, thereby not affecting the user's normal use of the second electronic device.

[0245] In some embodiments, performing decoding operations on key areas of multiple frames of images to obtain digital watermark information includes:

[0246] The first electronic device performs decoding operation on key areas of two adjacent frames of images of the multi-frame image to obtain digital watermark information.

[0247] Exemplarily, referring to FIG. 4 , the two adjacent frame images may be the T-th frame image and the T+1-th frame image. The first electronic device may use the T-th frame image to subtract the T+1-th frame image to obtain the digital watermark information.

[0248] In one embodiment of the present application, the first electronic device can perform a decoding operation on the key areas of two adjacent frames of images to obtain digital watermark information. This technical solution allows the first electronic device to obtain digital watermark information by processing the key areas of any two adjacent frames of images, thereby simplifying the implementation of the technical solution.

[0249] In some embodiments, performing decoding operations on key areas of multiple frames of images to obtain digital watermark information includes:

[0250] The first electronic device performs decoding operation on the key areas of two adjacent frames of images of the multiple frames of images;

[0251] The first electronic device superimposes the operation results of the key areas of two adjacent frames of images to obtain digital watermark information.

[0252] In one embodiment of the present application, the first electronic device can superimpose the calculation results of the key areas of two adjacent frames of images to make the digital watermark information finally obtained clearer, thereby increasing the possibility of the first electronic device accurately identifying the digital watermark information.

[0253] In other embodiments, the first electronic device may also perform decoding operations on key areas of two frames of images separated by several frames in the multi-frame image to obtain digital watermark information. In this case, when the second electronic device superimposes the device identification information on the key areas of the displayed image, it may also perform encoding at intervals of several frames, thereby reducing the encoding overhead of the second electronic device.

[0254] In some embodiments, digital watermark information is superimposed on each frame of a plurality of image frames, and a ratio of a size of the digital watermark information to a size of the image is greater than a second preset value, wherein determining the digital watermark information hidden in the plurality of image frames includes:

[0255] The first electronic device performs decoding operation on the entire image of the multiple frames to obtain digital watermark information.

[0256] For example, referring to Figure 5, the digital watermark information can be a two-dimensional barcode, which can be superimposed on the entire image. The two-dimensional barcode superimposed on the entire image can be understood as the size of a two-dimensional barcode can be the same as or slightly smaller than the size of the image.

[0257] In one embodiment of the present application, the digital watermark information is superimposed on the entire image of each frame, so that the size of the digital watermark information is large, and the user can use the camera of the first electronic device to obtain the digital watermark information at a greater distance from the second electronic device. Therefore, the first electronic device can establish a device connection from a distance from the second electronic device.

[0258] In some embodiments, performing a decoding operation on the entire image of the multiple frames to obtain digital watermark information includes:

[0259] The first electronic device performs decoding operation on the entire images of two adjacent frames of the multi-frame image to obtain digital watermark information.

[0260] In one embodiment of the present application, the first electronic device can perform decoding operations on the entire image of two adjacent frames of the multi-frame image to obtain digital watermark information. This technical solution allows the first electronic device to obtain digital watermark information by processing any two adjacent frames of the image, thereby simplifying the implementation of the technical solution.

[0261] In other embodiments, the first electronic device may also perform decoding operations on two frames of images separated by a certain number of frames in the multi-frame image to obtain digital watermark information. In this case, when the second electronic device superimposes the device identification information on the displayed image, it may also perform encoding at intervals of a certain number of frames, thereby reducing the encoding overhead of the second electronic device.

[0262] In some embodiments, performing a decoding operation on the entire image of the multiple frames to obtain digital watermark information includes:

[0263] The first electronic device performs decoding operation on the entire image of two adjacent frames of the multiple frames of image;

[0264] The first electronic device superimposes operation results of the entire image of two adjacent frames of images to obtain digital watermark information.

[0265] In one embodiment of the present application, the first electronic device can superimpose the operation results of the entire image of multiple adjacent frames of images to make the digital watermark information finally obtained clearer, thereby increasing the possibility of the first electronic device accurately identifying the digital watermark information.

[0266] In other embodiments, the first electronic device may also perform decoding operations on two frames of multiple images separated by several frames, and superimpose multiple operation results to obtain digital watermark information. In this case, when the second electronic device superimposes the device identification information on the displayed image, it may also encode it at intervals of several frames, thereby reducing the encoding overhead of the second electronic device.

[0267] In some embodiments, the method 800 may further include:

[0268] First indication information is sent to the second electronic device, where the first indication information is used to instruct the second electronic device to stop superimposing the digital watermark information onto the displayed image.

[0269] In the embodiment of the present application, the first electronic device may also send a first instruction message to the second electronic device to instruct it to stop superimposing the digital watermark information on the displayed image. This technical solution can prevent the second electronic device from continuously performing the encoding operation, thereby reducing the power consumption of the second electronic device.

[0270] In some embodiments, the device identification information includes at least one of a product serial number of the second electronic device, a MAC address of the second electronic device, or a digital number mapped from the product serial number.

[0271] In other embodiments, the device identification information may include, in addition to the above content, the model of the second electronic device, configuration information of the second electronic device, etc.

[0272] Figure 10 is a schematic block diagram of an electronic device provided in an embodiment of the present application. As shown in Figure 10, the electronic device 1000 may include one or more processors 1010; one or more memories 1020; the one or more memories 1020 store one or more programs, which, when executed by the one or more processors 1010, enable the device connection method described in any of the possible implementations described above to be executed.

[0273] In some embodiments, the electronic device 1000 may be the first electronic device mentioned above, for example, a smart phone, a tablet computer, etc.

[0274] In other embodiments, the electronic device 1000 may be the second electronic device mentioned above, for example, a tablet computer, a smart TV, a car device, a smart home device, etc.

[0275] An embodiment of the present application further provides a system, including the first electronic device and the second electronic device in the above embodiment.

[0276] An embodiment of the present application also provides a chip, which includes a processor and a communication interface, wherein the communication interface is used to receive a signal and transmit the signal to the processor, and the processor processes the signal so that the device connection method described in any possible implementation method described above is executed.

[0277] It is understandable that, in order to implement the above functions, the electronic device includes hardware and / or software modules that perform the corresponding functions. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and software. Whether a function is executed in a hardware or software-driven hardware manner depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of this application.

[0278] In this embodiment, the electronic device can be divided into functional modules according to the above-mentioned method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into a single processing module. The above-mentioned integrated modules can be implemented in the form of hardware. It should be noted that the module division in this embodiment is illustrative and is only a logical functional division. In actual implementation, other division methods may be used.

[0279] This embodiment further provides a device connection apparatus, comprising a module for implementing the device connection method in the above embodiment.

[0280] This embodiment further provides a readable storage medium, which stores instructions. When the instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the device connection method in the above-mentioned embodiment.

[0281] This embodiment further provides a program product. When the program product is run on an electronic device, the electronic device executes the above-mentioned related steps to implement the device connection method in the above-mentioned embodiment.

[0282] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store execution instructions, and when the device is running, the processor can execute the execution instructions stored in the memory to enable the chip to execute the device connection method in the above-mentioned method embodiments.

[0283] Among them, the display device, electronic device, readable storage medium, program product or chip provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0284] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0285] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0286] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0287] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0288] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0289] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0290] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A system, characterized in that: The system includes a first electronic device and a second electronic device, wherein: The second electronic device is used to hide and superimpose digital watermark information including device identification information of the second electronic device onto the multiple frames of images displayed by the second electronic device; The first electronic device is configured to: acquire the multiple frames of images through a camera when a first operation is detected; Determining the digital watermark information hidden in the multiple frames of images; Determine the device identification information of the second electronic device through the digital watermark information; A connection relationship is established with the second electronic device according to the device identification information.

2. The system according to claim 1, characterized in that The first electronic device is specifically used for: Determine a key area of ​​the multi-frame image, the key area being an area in the multi-frame image whose texture complexity is greater than a first preset value; A decoding operation is performed on the key areas of the multiple frames of images to obtain the digital watermark information.

3. The system according to claim 1 or 2, characterized in that: The first electronic device is specifically used for: Performing decoding operation on two adjacent frames of images of the multiple frames of images; The digital watermark information is obtained by superimposing the operation results of two adjacent frames of images.

4. The system according to claim 1, characterized in that The digital watermark information is superimposed on each frame of the multiple frames of images, and the ratio of the size of the digital watermark information to the size of the image is greater than a second preset value, wherein the first electronic device is specifically used to: A decoding operation is performed on the entire image of the multiple frames of images to obtain the digital watermark information.

5. A method for connecting a device, characterized in that: The method is applied to a first electronic device, and the method includes: Upon detecting the first operation, a plurality of frames of images displayed by the second electronic device are acquired through a camera, wherein digital watermark information is hidden in the plurality of frames of images, and the digital watermark information includes device identification information of the second electronic device; Determining the digital watermark information hidden in the multiple frames of images; Determine the device identification information of the second electronic device through the digital watermark information; A connection relationship is established with the second electronic device according to the device identification information.

6. The method according to claim 5, characterized in that The step of determining the digital watermark information hidden in the multiple frames of images comprises: Determine a key area of ​​the multi-frame image, the key area being an area in the multi-frame image whose texture complexity is greater than a first preset value; The digital watermark information is determined by the key areas of the multiple frames of images.

7. The method according to claim 6, characterized in that The step of determining the digital watermark information through the key areas of the multiple frames of images includes: A decoding operation is performed on the key areas of the multiple frames of images to obtain the digital watermark information.

8. The method according to claim 7, characterized in that The decoding operation is performed on the key areas of the multiple frames of images to obtain the digital watermark information, including: A decoding operation is performed on key areas of two adjacent frames of the multiple frames of images to obtain the digital watermark information.

9. The method according to claim 7, characterized in that: The decoding operation is performed on the key areas of the multiple frames of images to obtain the digital watermark information, including: Performing decoding operation on key areas of two adjacent frames of images of the multiple frames of images; The digital watermark information is obtained by superimposing the operation results of the key areas of two adjacent frames of images.

10. The method according to claim 5, characterized in that The digital watermark information is superimposed on each frame of the multiple frames of images, and the ratio of the size of the digital watermark information to the size of the image is greater than a second preset value, wherein determining the digital watermark information hidden in the multiple frames of images includes: A decoding operation is performed on the entire image of the multiple frames of images to obtain the digital watermark information.

11. The method according to claim 10, characterized in that The decoding operation is performed on the entire image of the multiple frames of images to obtain the digital watermark information, including: A decoding operation is performed on the entire image of two adjacent frames of the multiple frames of images to obtain the digital watermark information.

12. The method according to claim 10, characterized in that The decoding operation is performed on the entire image of the multiple frames of images to obtain the digital watermark information, including: Performing decoding operation on the entire images of two adjacent frames of the multiple frames of images; The digital watermark information is obtained by superimposing the operation results of the whole image of multiple adjacent two frames of images.

13. The method according to any one of claims 5 to 12, characterized in that: The method further comprises: Sending first indication information to the second electronic device, where the first indication information is used to instruct the second electronic device to stop superimposing the digital watermark information on the displayed image.

14. The method according to any one of claims 5 to 13, characterized in that: The digital watermark information is a barcode; the device identification information includes at least one of a product serial number of the second electronic device, a media access control MAC address of the second electronic device, or a digital number mapped from the product serial number.

15. A method for connecting a device, characterized in that: The method is applied to a second electronic device, and the method includes: receiving second instruction information sent by the first electronic device, where the second instruction information is used to instruct the second electronic device to superimpose device identification information onto a displayed image; According to the second indication information, digital watermark information including the device identification information of the second electronic device is hidden and superimposed on the displayed image, and the digital watermark information is used to establish a connection relationship between the first electronic device and the second electronic device.

16. The method according to claim 15, characterized in that The step of hiding and superimposing the digital watermark information including the device identification information of the second electronic device onto the displayed image according to the second indication information includes: The digital watermark information is superimposed on a key area of ​​the image according to the second indication information, where the key area is an area in the image where the texture complexity is greater than a first preset value.

17. The method according to claim 15, characterized in that The step of hiding and superimposing the digital watermark information including the device identification information of the second electronic device onto the displayed image according to the second indication information includes: The digital watermark information is superimposed on the entire image of the image according to the second indication information, wherein a ratio of a size of the digital watermark information to a size of the image is greater than a second preset value.

18. The method according to any one of claims 15 to 17, characterized in that: The method further comprises: Receiving first indication information sent by the first electronic device; Stop hiding and superimposing the digital watermark information on the displayed image according to the first indication information.

19. The method according to any one of claims 15 to 18, characterized in that The digital watermark information is a barcode; the device identification information includes at least one of a product serial number of the second electronic device, a media access control MAC address of the second electronic device, or a digital number mapped from the product serial number.

20. An electronic device, characterized in that: include: one or more processors; One or more memories; the one or more memories store one or more programs, and when the one or more programs are executed by the one or more processors, the method for connecting the device as described in any one of claims 5 to 19 is executed.

21. A chip, characterized in that: The chip includes a processor and a communication interface, wherein the communication interface is used to receive a signal and transmit the signal to the processor, and the processor processes the signal so that the device connection method according to any one of claims 5 to 19 is executed.

22. A readable storage medium, characterized in that: The readable storage medium stores instructions, and when the instructions are executed on the electronic device, the device connection method according to any one of claims 5 to 19 is executed.

Images