Device connection method and device

Abstract

Provided in the present application are a device connection method and device. The method may comprise: upon detecting that a trigger condition is met, the second device converting device connection information into binary code information, and controlling a display screen to change the luminance on the basis of the binary code information; and upon detecting a first operation, the first device acquiring, by means of a camera, multiple frames of images displayed by the second device, determining the binary code information by means of the multiple frames of images, determining the device connection information of the second device on the basis of the binary code information, and then establishing a connection relationship with the second device on the basis of the device connection information. The technical solution can shorten an interaction path for a device connection and simplify the process of the device connection, thereby making the device connection more convenient.

Description

Device connection method and device

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on August 11, 2023, with application number 202311013381.2 and application name “Method and device for device connection”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present application relate to the field of electronic technology, and more particularly, to a method and device for connecting devices. Background Art

[0003] Currently, users have more and more devices, and scenarios where device connection is required often occur. For example, scanning QR codes is currently commonly used to connect devices. However, this method requires the device to display the QR code on a specific interface through user operation when connecting devices, making the interactive path for device connection long and the steps cumbersome.

[0004] Therefore, how to conveniently achieve device connection becomes a technical problem that needs to be solved.

[0005] Summary of the Invention

[0006] The present application provides a method and device for device connection, which can shorten the interactive path of device connection, simplify the process of device connection, and make device connection more convenient.

[0007] In a first aspect, a method for device connection is provided, which is applied to a first device and includes: detecting a first operation, and acquiring multiple frames of images displayed by a second device through a camera; determining binary coded information through the multiple frames of images, wherein the binary coded information includes device connection information of the second device; determining the device connection information of the second device based on the binary coded information; and establishing a connection relationship with the second device based on the device connection information.

[0008] Based on the embodiments of the present application, when the first device detects the first operation, it can obtain multiple frames of images displayed by the second device through the camera, determine binary coding information through the multiple frames of images, determine the device connection information of the second device based on the binary coding information, and further establish a connection relationship with the second device through the device connection information.

[0009] In this way, when connecting devices, the user only needs to perform the operation to trigger the establishment of the device connection, and then use the camera of the first device to shoot or scan the image displayed by the second device and identify the device connection information of the image. The connection between the first device and the second device can be completed through the device connection information, thereby shortening the interaction path of the device connection, simplifying the device connection process, and making device connection more convenient.

[0010] In combination with the first aspect, in an implementation of the first aspect, determining the binary coded information through the multiple frames of images includes: performing signal processing on the multiple frames of images to obtain first brightness and darkness change information in the multiple frames of images; and determining the binary coded information based on the first brightness and darkness change information.

[0011] For example, the signal processing method may be envelope analysis, curve fitting, or the like.

[0012] The brightness change corresponding to the first brightness change information can be achieved by the second device adjusting the brightness of the light source, or the brightness change corresponding to the first brightness change information can be achieved by the second device controlling the light source to turn on or off, or the brightness change corresponding to the first brightness change information can also be achieved by the second device adjusting the brightness value of the pixels of the displayed image.

[0013] Based on the embodiment of the present application, the first device can perform signal processing on the acquired multiple frames of images to determine the first brightness and darkness change information in the image, and determine the binary coding information based on the first brightness and darkness change information, so as to determine the device connection information of the second device.

[0014] In combination with the first aspect, in an implementation method of the first aspect, signal processing is performed on the multiple frames of images to obtain first light and dark change information in the multiple frames of images, including: identifying partial areas with light and dark changes in the multiple frames of images; performing signal processing on the partial areas in the multiple frames of images to obtain first light and dark change information of the partial areas.

[0015] Based on the embodiment of the present application, the second device can control part of the light sources of the display screen to change brightness according to the binary coded information, so that the first device can perform signal processing on the partial area with brightness changes of the acquired multi-frame images to obtain the corresponding first brightness change information, thereby reducing the amount of data for signal processing while also being able to identify the corresponding binary coded information.

[0016] Optionally, the partial area may also be any area with a preset area in multiple frames of images.

[0017] In combination with the first aspect, in an implementation method of the first aspect, obtaining multiple frames of images displayed by the second device through a camera includes: obtaining multiple frames of images of multiple display partitions of the display screen of the second device through the camera; wherein, determining the binary coding information through the multiple frames of images includes: performing signal processing on the multiple frames of images of the multiple display partitions in a preset order to obtain second brightness and darkness change information in the multiple frames of images of the multiple display partitions; and determining the binary coding information based on the second brightness and darkness change information.

[0018] Based on the embodiments of the present application, the second device may further divide the display screen into multiple display partitions, and may control the multiple display partitions to change brightness according to the binary coded information in a preset order. In this case, the first device may obtain multiple frames of images of the multiple display partitions, perform signal processing on the multiple frames of images of the multiple display partitions in a preset order, obtain second brightness change information from the multiple frames of images of the multiple display partitions, and further determine the corresponding binary coded information.

[0019] In this case, the binary coded information that can be transmitted by the multiple display partitions has a larger data volume, so that the first device can obtain more data from the multiple frames of images of the multiple display partitions.

[0020] In combination with the first aspect, in an implementation of the first aspect, obtaining the multiple frames of images displayed by the second device through the camera includes: obtaining the multiple frames of images through a slow motion mode of the camera.

[0021] In other examples, the first device may also obtain the above-mentioned multiple frames of images through the normal mode of the camera, which is not limited in the embodiments of the present application.

[0022] In combination with the first aspect, in an implementation manner of the first aspect, the device connection information includes at least one of a connection pairing code of the second device, a product serial number of the second device, and a media access control MAC address of the second device.

[0023] In other examples, the device connection information may also include other information, such as mapping information of the product serial number of the second device, configuration information of the second device, etc.

[0024] In a second aspect, a method for device connection is provided, which is applied to a second device, and includes: when it is detected that a trigger condition is met, converting the device connection information of the second device into binary coded information, and the device connection information is used to establish a connection relationship between the second device and the first device; controlling the display screen of the second device to change brightness according to the binary coded information.

[0025] Based on the embodiment of the present application, when the second device detects that the trigger condition is met, it can convert the device connection information into binary coded information and control the display screen to change the brightness according to the binary coded information, so that the second device can transmit the binary coded information to the outside, so that other devices can perform the device connection process by simply scanning or capturing multiple frames of images of the display screen of the second device, making device connection more convenient.

[0026] In combination with the second aspect, in an implementation of the second aspect, controlling the display screen of the second device to change brightness according to the binary coded information includes: controlling the light source of the backlight layer of the display screen to increase or decrease brightness according to the binary coded information.

[0027] For example, for binary coded information "1", the second device can increase the current or voltage of the light source of the backlight layer so that the light source increases its brightness; or, for binary coded information "0", the second device can reduce the current or voltage of the light source of the backlight layer so that the light source reduces its brightness.

[0028] This technical solution enables the second device to control the brightness of the display screen according to the binary coded information to transmit the binary coded information to the outside.

[0029] In combination with the second aspect, in an implementation of the second aspect, controlling the display screen of the second device to change brightness according to the binary coded information includes: controlling the light source of the backlight layer of the display screen to light up or turn off according to the binary coded information.

[0030] For example, for binary coded information “1”, the second device may control the light source of the backlight layer to light up; for binary coded information “0”, the second device may control the light source of the backlight layer to turn off.

[0031] This technical solution enables the second device to control the brightness of the display screen according to the binary coded information to transmit the binary coded information to the outside.

[0032] In combination with the second aspect, in an implementation of the second aspect, controlling the display screen of the second device to change brightness according to the binary coded information includes: increasing or decreasing the brightness value of pixels of the image displayed on the display screen according to the binary coded information.

[0033] For example, for binary coded information "1", the second device can increase the brightness value of the pixels of the displayed image to make the displayed image brighter; for binary coded information "0", the second device can reduce the brightness value of the pixels of the displayed image to make the displayed image brighter.

[0034] This technical solution enables the second device to control the brightness of the display screen according to the binary coded information to transmit the binary coded information to the outside.

[0035] In combination with the second aspect, in an implementation of the second aspect, the display screen includes multiple display partitions, wherein controlling the display screen of the second device to change brightness according to the binary coded information includes: controlling the multiple display partitions to change brightness according to the binary coded information in a preset order.

[0036] Based on the embodiment of the present application, the display screen of the second device can be divided into multiple display partitions, and the second device can control the multiple display partitions to change brightness according to the binary coded information in a preset order. In this way, the second device can transmit more data.

[0037] In combination with the second aspect, in an implementation of the second aspect, controlling the display screen of the second device to change brightness according to the binary coded information includes: controlling a partial area of ​​the display screen of the second device to change brightness according to the binary coded information.

[0038] Based on the embodiment of the present application, the second device can also control the brightness of a part of the display screen according to the binary coding information, thereby reducing the coding overhead of the second device and reducing the power consumption of the second device.

[0039] In a third aspect, a system is provided, comprising a first device and a second device, wherein the second device is configured to: upon determining that a trigger condition is satisfied, convert device connection information of the second device into binary coded information, the device connection information being used to establish a connection between the second device and the first device; and control a display screen of the second device to change brightness according to the binary coded information;

[0040] The first device is used to: detect a first operation and obtain multiple frames of images displayed by the second device through a camera; determine the binary coded information through the multiple frames of images, wherein the binary coded information includes device connection information of the second device; determine the device connection information of the second device based on the binary coded information; and establish a connection relationship with the second device based on the device connection information.

[0041] In a fourth aspect, a device is provided, comprising: one or more processors; one or more memories; the one or more memories storing one or more computer programs, the one or more computer programs comprising instructions, which, when executed by the one or more processors, enable the method for connecting the devices as described in the first aspect and any possible implementation thereof to be executed.

[0042] In a fifth aspect, a device is provided, comprising: one or more processors; one or more memories; the one or more memories storing one or more computer programs, the one or more computer programs comprising instructions, which, when executed by one or more processors, enable the method for connecting the devices as described in the second aspect and any possible implementation thereof to be executed.

[0043] In a sixth aspect, a device connection apparatus is provided, comprising: a module for implementing the device connection method as described in the first aspect and any possible implementation thereof, or the second aspect and any possible implementation thereof.

[0044] In the seventh aspect, a chip is provided, which includes a processor and a communication interface, wherein the communication interface is used to receive a signal and transmit the signal to the processor, and the processor processes the signal so that the device connection method described in the first aspect and any possible implementation thereof is executed.

[0045] In the eighth aspect, a chip is provided, which includes a processor and a communication interface, wherein the communication interface is used to receive a signal and transmit the signal to the processor, and the processor processes the signal so that the device connection method described in the second aspect and any possible implementation thereof is executed.

[0046] In a ninth aspect, a readable storage medium is provided, wherein the readable storage medium stores instructions. When the instructions are executed on a device, the device connection method as described in the first aspect and any possible implementation thereof is executed.

[0047] In a tenth aspect, a readable storage medium is provided, wherein instructions are stored in the readable storage medium. When the instructions are executed on a device, the device connection method as described in the second aspect and any possible implementation thereof is executed.

[0048] In an eleventh aspect, a program product is provided, comprising a program code, which, when executed on an electronic device, enables the device connection method as described in the first aspect and any possible implementation thereof to be executed.

[0049] In a twelfth aspect, a program product is provided, comprising a program code. When the program code is run on an electronic device, the device connection method as described in the second aspect and any possible implementation thereof is executed. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] FIG1 is a schematic diagram of the structure of the device provided in an embodiment of the present application.

[0051] FIG2 is a schematic diagram of the software structure of the device provided in an embodiment of the present application.

[0052] FIG3 is a schematic diagram of a scenario to which the embodiments of the present application may be applied.

[0053] FIG4 is a schematic diagram of a display screen provided by an embodiment of the present application showing changes in brightness according to binary coded information.

[0054] FIG5 is a schematic diagram of different display partitions of a display screen provided by an embodiment of the present application transmitting different binary coded information to the outside.

[0055] FIG6 is a schematic diagram showing different binary coded information transmitted to the outside by different display partitions of another display screen provided by an embodiment of the present application.

[0056] FIG7 is a schematic diagram of an embodiment of the present application providing a method for transmitting different binary coded information through bright or dark display of an image.

[0057] FIG8 is a schematic interaction diagram of a device connection method provided in an embodiment of the present application.

[0058] FIG9 is a schematic block diagram of a device according to an embodiment of the present application. DETAILED DESCRIPTION

[0059] The technical solution in this application will be described below with reference to the accompanying drawings.

[0060] The device connection method in the embodiments of the present application can be applied to devices such as smartphones, monitors, smart TVs, tablet computers, laptops, personal computers (PCs), ultra-mobile personal computers (UMPCs), netbooks, vehicle-mounted devices, car computers, wearable devices, foldable devices, and Internet of Things (IoT) devices with display screens.

[0061] 1 shows a schematic diagram of the structure of a device 100. The device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0062] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the device 100. In other embodiments of the present application, the device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0063] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0064] In this application, the processor 110 can be used to encode and decode images. For example, the processor 110 in one device can be used to dim a display screen based on binary coded information, where the binary coded information includes device connection information. The processor in another device can be used to identify the device connection information from a captured image.

[0065] The controller may be the nerve center and command center of the device 100. The controller may generate an operation control signal based on the instruction operation code and the timing signal to complete the control of instruction fetching and execution.

[0066] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0067] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus interface.

[0068] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL).

[0069] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170.

[0070] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface.

[0071] The UART interface is a universal serial data bus used for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160.

[0072] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193.

[0073] The GPIO interface can be configured via software. The GPIO interface can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc.

[0074] The USB interface 130 is an interface that complies with USB standards, and may be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 may be used to connect a charger to charge the device 100, and may also be used to transmit data between the device 100 and peripheral devices.

[0075] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely illustrative and does not constitute a structural limitation on the device 100. In other embodiments of the present application, the device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0076] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the device 100. While charging the battery 142, the charging management module 140 can also provide power to the device via the power management module 141.

[0077] The power management module 141 is used to connect the battery 142 , the charging management module 140 and the processor 110 .

[0078] The wireless communication function of the device 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0079] The mobile communication module 150 can provide wireless communication solutions including 2G / 3G / 4G / 5G applied on the device 100.

[0080] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0081] The wireless communication module 160 can provide wireless communication solutions applied on the device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), Bluetooth low energy (BLE), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc.

[0082] In some embodiments, antenna 1 of device 100 is coupled to mobile communication module 150 , and antenna 2 is coupled to wireless communication module 160 , so that device 100 can communicate with a network and other devices via wireless communication technology.

[0083] Device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0084] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), or a display panel made of one of the following materials: organic light-emitting diode (OLED), active-matrix organic light-emitting diode (AMOLED), flexible light-emitting diode (FLED), MiniLED, MicroLED, Micro-oLed, or quantum dot light-emitting diode (QLED). In some embodiments, device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0085] In the embodiment of the present application, the device 100 can display an image through the display screen 194, and display an image superimposed with digital watermark information.

[0086] The device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display 194, and an application processor.

[0087] The ISP is used to process data fed back by the camera 193. The camera 193 is used to capture still images or videos. In this application, the camera 193 can be used to obtain an image displayed on a display screen of another device.

[0088] Digital signal processors are used to process digital signals. In addition to processing digital image signals, they can also process other digital signals.

[0089] Video codecs are used to compress or decompress digital videos. Device 100 may support one or more video codecs.

[0090] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the device 100.

[0091] The internal memory 121 may be used to store computer executable program codes, which include instructions. The processor 110 executes the instructions stored in the internal memory 121 to execute various functional applications and data processing of the device 100.

[0092] The device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0093] The audio module 170 is used to convert digital audio information into analog audio signals for output, and is also used to convert analog audio input into digital audio signals.

[0094] The speaker 170A, also called a "horn", is used to convert audio electrical signals into sound signals.

[0095] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals.

[0096] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.

[0097] The headphone jack 170D is used to connect a wired headphone.

[0098] The pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194 .

[0099] The gyro sensor 180B may be used to determine the motion posture of the device 100 .

[0100] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the device 100 calculates altitude using the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.

[0101] The acceleration sensor 180E can detect the magnitude of the acceleration of the device 100 in various directions (generally three axes).

[0102] The distance sensor 180F is used to measure distance.

[0103] The fingerprint sensor 180H is used to collect fingerprints.

[0104] The touch sensor 180K is also called a “touch panel.” The touch sensor 180K can be disposed on the display screen 194 . The touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen.”

[0105] Bone conduction sensor 180M can acquire vibration signals. In some embodiments, bone conduction sensor 180M can acquire vibration signals from vibrating bones in the human body. Bone conduction sensor 180M can also contact the human pulse to receive blood pressure signals.

[0106] The buttons 190 include a power button, a volume button, and the like.

[0107] Motor 191 can generate vibration prompts.

[0108] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.

[0109] The SIM card interface 195 is used to connect a SIM card.

[0110] The software system of device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This embodiment of the application uses an operating system with a layered architecture as an example to illustrate the software structure of device 100. Figure 2 is a schematic diagram of the software structure of the device provided in this embodiment of the application.

[0111] Currently, users have more and more devices, and scenarios where device connection is required often occur. For example, scanning QR codes is currently commonly used to connect devices. However, this method requires the device to display the QR code on a specific interface through user operation when connecting devices, making the interactive path for device connection long and the steps cumbersome.

[0112] In view of this, embodiments of the present application provide a method and device for device connection. In this technical solution, device A can convert device connection information used for device connection into binary coded information, and when displaying an image, control the display screen to display bright or dim the display screen according to the binary coded information, or control the display screen to light up or turn off, in order to transmit the binary coded information; another device B can obtain multiple frames of images displayed by device A through a camera to obtain the binary coded information therein, and determine the device connection information based on the binary coded information, and further establish a connection relationship with device A.

[0113] This technical solution allows device A and device B to be connected. The user only needs to perform an operation to trigger the establishment of a device connection, and then use the camera of device B to scan multiple frames of images displayed by device A and determine the device connection information to trigger the pairing connection between device A and device B. This can shorten the interaction path of the device connection, simplify the device connection process, and make device connection more convenient.

[0114] For example, Figure 3 is a schematic diagram of a scenario to which the embodiments of the present application may be applied. As shown in Figure 3, a connection relationship between a mobile phone 200b and other devices is established as an example for explanation.

[0115] Referring to (a) in Figure 3 , this scenario includes vehicle 200a and mobile phone 200b. The cabin of vehicle 200a may include an instrument panel 201, a display screen 202 (or a central control panel), a display screen 203 (or a passenger entertainment panel), a display screen 204 (or a second-row left entertainment panel), and a display screen 205 (or a second-row right entertainment panel).

[0116] In one example, the vehicle 200a may convert the device connection information of the vehicle 200a into binary coded information, and when the display screen 203 displays an image, control the display screen 203 to display the image brightly or darkly according to the binary coded information.

[0117] For example, when display screen 203 displays wallpaper A, vehicle 200a can control display screen 203 to display wallpaper A1 with a higher brightness than the original wallpaper A in one frame, wallpaper A2 with a lower brightness than the original wallpaper A in the next frame, wallpaper A1 in the next frame, wallpaper A2 in the next frame, and so on. This can be understood as display screen 203 switching between bright and dark a preset number (e.g., 300) times per second. Bright wallpaper A1 displayed on display screen 203 can represent a coded message "1," while dim wallpaper A2 displayed on display screen 203 can represent a coded message "0." Thus, display screen 203 can transmit binary coded information through changes in brightness. When a user uses the camera of mobile phone 200b to scan or capture multiple frames of images displayed on display screen 203, signal analysis can be performed on the acquired multiple frames to identify the binary coded information therein, and the device connection information of vehicle 200a can be determined based on this binary coded information. This allows mobile phone 200b to establish a connection with vehicle 200a.

[0118] It should be understood that wallpaper A, wallpaper A1 and wallpaper A2 have the same content, but different brightness.

[0119] For another example, when the display screen 203 displays wallpaper A, the vehicle 200a can control the display screen 203 to display wallpaper A for one frame, turn off the display screen for the next frame, display wallpaper A for the next frame, turn off the display screen for the next frame, and so on. In this way, it can be understood that the display screen 203 switches between lighting and extinguishing a preset number (e.g., 300) times per second. The display screen 203 lighting up can represent the coded information "1", and the display screen 203 extinguishing can represent the coded information "0", so that the display screen 203 can transmit binary coded information to the outside through the change of light and dark. It should be understood that "bright" here can be understood as the display screen lighting up and displaying an image normally, and "dark" can be understood as the display screen being off and not displaying any image.

[0120] The device connection information may be one or more of a pairing code, a product serial number, a media access control (MAC) address, device model information, device name, or device configuration information. Alternatively, the device identification information may be a mapping of the above information. For example, since a device's product serial number is generally 15 digits, to reduce encoding overhead, the device identification information may also be a mapping of the device's product serial number, for example, mapping the device's product serial number into a 6-digit or 8-digit number.

[0121] The following description uses the example of a Bluetooth connection between mobile phone 200b and vehicle 200a, where the device connection information is a pairing code. For example, the pairing code may consist of six digits, such as 656579. The binary code corresponding to the pairing code is "0110 0101 0110 0101 01111001." The binary code "0" represents a dimmed display, while the binary code "1" represents a bright display. Display screen 203 can then display an image in either bright or dimmed mode based on this binary code. Vehicle 200a can control display screen 203 to cycle through the binary code "0110 0101 0110 0101 0111 1001." Simultaneously, vehicle 200a can broadcast Bluetooth messages that carry the aforementioned device connection information. Mobile phone 200b can capture multiple frames of images of display screen 203 using its camera, further perform signal analysis on the multiple frames to determine the binary code information, and then determine the corresponding device connection information based on the binary code information. At the same time, the mobile phone 200b scans the Bluetooth message of the vehicle 200a, and determines that the device to be connected is the vehicle 200a according to the obtained device connection information, so that the mobile phone 200b can perform Bluetooth pairing with the vehicle 200a to establish a Bluetooth communication connection.

[0122] Because the display screen 203 can change at a preset frequency (e.g., 300) times per second, the change speed is too fast to be recognized by the human eye, and the user's eyes cannot perceive the change in brightness of the display screen 203. Therefore, to the user, the display screen 203 displays images normally, but can also connect to devices, giving the user a good sense of technology and experience.

[0123] It is understandable that the display screen 203 of the vehicle 200a can always display images in the above manner, so that the user can scan or shoot the image displayed on the display screen 203 at any time through the mobile phone 200b to connect the device, thereby improving the efficiency of device connection and user experience.

[0124] In other examples, only when the vehicle 200a detects that the trigger condition is met will it control the display screen 203 to display the image in the above display manner, thereby saving device power consumption to a certain extent.

[0125] The trigger condition may be at least one of the following: the vehicle door on the display screen 203 side is closed; there is someone on the seat where the display screen 203 is located; the distance between the mobile phone 200b and the display screen 203 is less than or equal to a preset distance, etc.

[0126] It should be understood that in the embodiments of the present application, the display screen 203 of the vehicle 200a displays an image in the above display manner as an example, but this should not be a limitation of the present application. In other examples, other display screens in the vehicle 200a may also display images in the above display manner, and the embodiments of the present application are not limited thereto.

[0127] In this application, this technical solution can also be applied to the device connection solution in the home scenario, see (b) in Figure 3, the user's home may include devices such as smart TV 300a, smart TV 300b, smart TV 300c, PC 300d and tablet 300e.

[0128] Smart TV 300a, smart TV 300b, smart TV 300c, PC 300d and tablet 300e can display images in the above-mentioned display manner, or can also display images in the above-mentioned display manner when detecting that the above-mentioned trigger conditions are met, so that when the user wants to establish a device connection, he can scan or shoot the image displayed by the device through the mobile phone 200b to connect the device. This technical solution can shorten the interactive path of device connection, simplify the device connection process, and make device connection more convenient.

[0129] For example, when the mobile phone 200b and the smart TV 300c are in the same local area network or logged in to the same Huawei account, and the device connection information is the pairing code, product serial number or MAC address of the device, after the mobile phone 200b obtains the device connection information of the smart TV 300c, the pairing code, product serial number or MAC address of the smart TV 300c can be obtained from the device connection information, so that the mobile phone 200b can establish a connection relationship with the smart TV 300c.

[0130] Alternatively, when mobile phone 200b and smart TV 300c are in the same local area network or logged in to the same Huawei account, when the device connection information is a digital number mapped to the product serial number of smart TV 300c, after mobile phone 200b obtains the device connection information of smart TV 300c, it can obtain the digital number mapped to the product serial number of smart TV 300c from the device connection information, and further identify smart TV 300c based on the digital number, so that mobile phone 200b can establish a connection relationship with smart TV 300c.

[0131] In the above embodiment, the entire display screen of the device can be synchronously illuminated or dimmed according to the binary coded information. Therefore, when connecting the devices, the mobile phone 200b only needs to scan or capture a portion of the display screen to obtain the binary coded information, determine the device connection information, and trigger the connection pairing to connect the devices. This allows for convenient device connection even when the display screen is partially obscured, thus expanding the scope of device connection.

[0132] In the embodiment of the present application, there are several ways for the device to control the display screen to display light or dark according to binary coded information.

[0133] Method 1: The device controls the display screen to display bright or dark synchronously according to the binary coded information.

[0134] Method 2: The device controls the display screen to light up or darken the display in different areas according to the binary coded information.

[0135] Method 3: The device controls the brightness of the image displayed on the display screen to display bright or dark according to the binary coded information.

[0136] Specifically, in an example of method one, the device can control the lighting of the display screen by turning on the light source of the backlight layer of the display screen, and control the lighting of the display screen by turning off the light source of the backlight layer of the display screen. In this technical solution, lighting the display screen can be understood as a bright display, and turning off the display screen can be understood as a dark display. The lighting or turning off of the display screen depends on the light source of the backlight layer of the display screen. When the light source is emitting light, the display screen is in a lit state; when the light source is off, the display screen is in an off state. The device can control the light source of the backlight layer to emit light or turn off according to binary coded information to realize the lighting or turning off of the display screen.

[0137] For example, for a binary number "1", the light source is controlled to light up so that the display screen is lit; for a binary number "0", the light source is controlled to turn off so that the display screen is turned off.

[0138] It can be understood that lighting the light source can also be understood as the light source emitting light.

[0139] For example, FIG4 is a schematic diagram of a display screen provided by an embodiment of the present application showing changes in brightness according to binary coded information.

[0140] Before the device displays an image, the device needs to convert the device connection information into binary coded information. For example, if the device connection information is a pairing code, the device may first convert the pairing code into corresponding binary coded information.

[0141] Referring to Figure 4 , for example, the binary code corresponding to the number 6 in the pairing code is "0110." Device A can control the backlight layer's light source to illuminate or extinguish based on this binary code "0110." Specifically, the light source can execute a sequence of "extinguish-on-maintain-on-off" to transmit the binary code "0110." For the binary code corresponding to the number 5 in the pairing code is "0101," device A can control the backlight layer's light source to illuminate or extinguish based on this binary code "0101." Specifically, the light source can execute a sequence of "extinguish-on-off-on-off" to transmit the binary code "0101." It should be understood that device A can process other numbers in the pairing code in the same manner.

[0142] It should be understood that the light source of the backlight layer here being “off” or “on” may be the state of the light source in one frame.

[0143] For example, device A can turn on and off the light source by adjusting the switch of the backlight layer light source.

[0144] When a user wishes to connect devices, for example, if the user wishes to use device B to establish a connection with device A, device B may, based on the user's first operation, invoke a camera to scan or capture multiple frames of images displayed on the display screen of device A. Device B may then perform signal processing on the acquired multiple frames of images to identify binary coded information therein and further determine a corresponding pairing code based on the binary coded information. Device B may then send a pairing request to device A based on the pairing code to establish a device connection.

[0145] It is understandable that in order for device B to obtain the correct binary coded information, device A can control the light source of the backlight layer to change brightness in a cycle according to the binary coded information. Before each cycle, device A can control the brightness of a preset number of consecutive frames to be the same to serve as a mark. In this way, when device B performs signal processing on the acquired multiple frames of image, it can start identification from the frame after the mark to accurately obtain the corresponding binary coded information. For example, if the pairing code is a 6-digit number, then the binary coded information is the binary coded information corresponding to the 6-digit number. Before controlling the light source of the backlight layer to change brightness in a cycle according to the binary coded information, device A first controls the light source of the backlight layer to light up or turn off for 3 consecutive frames to serve as a mark. The above-mentioned preset number can also be other values, such as 4. The embodiment of the present application does not limit the specific value of the preset number.

[0146] Exemplarily, the method in which device B performs signal processing on the acquired multi-frame image sequence may be envelope analysis, curve fitting, etc., and the embodiment of the present application does not limit the specific method of the signal processing.

[0147] Taking envelope analysis as an example of signal processing, after performing envelope analysis on the acquired multiple frames of images, the corresponding envelope spectrum can be obtained, so that the corresponding binary coding information can be further determined.

[0148] The first operation may be an operation of clicking the scan subfunction or the slow motion subfunction in the camera application; or, the first operation may be an operation of the user sliding from a fixed area of ​​the display screen of device B, for example, the first operation is an operation of the user sliding along a certain angle starting from a corner of the display screen; or, there is a shortcut function button in the control center of the drop-down menu bar of device B, and the first operation may be an operation of the user clicking the function button.

[0149] In the embodiment of the present application, the device connection information is a pairing code as an example for illustration. In other examples, when the device connection information is a product serial number, MAC address or device model information, the device can be processed in the same way. For the sake of brevity, it is not repeated here.

[0150] Because the display's backlight can change at a preset frequency (e.g., 300 or 150 times per second), the frequency of the light source's brightness changes according to binary coded information, exceeding the human eye's range of recognition. This frequency, defined as the number of frames per second, prevents users from perceiving the display's brightness changes. This device connection method is both convenient and enhances the user experience.

[0151] It is understandable that the entire display screen of device A may be synchronously lit or extinguished according to the binary coded information, or a portion of the display screen of device A may be synchronously lit or extinguished according to the binary coded information.

[0152] For example, device A may also control a display area of ​​a preset area or a preset shape in the middle of the display screen to light up or go out according to binary coded information, while the rest of the display screen displays normally.

[0153] For example, the preset area is 1 / N of the area of ​​the display screen, where N is a positive integer greater than 1. The preset shape is a circle or a rectangle.

[0154] Alternatively, device A can control a display area of ​​a preset area in the upper left corner, or the upper right corner, or the lower left corner, or the lower right corner of the display screen to light up or go out according to binary coded information, such as the preset area is 1 / N of the area of ​​the display screen, where N is a positive integer greater than 1.

[0155] When part of the display screen of device A is synchronously lit or extinguished according to binary coded information, when connecting the devices, only by scanning the image of a specific display area can the devices be paired and connected, thereby enhancing the technological sense of the device connection.

[0156] In some other examples of the first method, the device A can also achieve bright or dark display on the display screen by adjusting the voltage or current of the light source of the backlight layer.

[0157] Among them, when the voltage of the backlight layer light source is high or the current is large, the brightness of the light source is high and the image displayed on the display screen is brighter; when the voltage of the backlight layer light source is low or the current is small, the brightness of the light source is low and the image displayed on the display screen is darker.

[0158] For example, when the binary coded information is "1", the device can increase the voltage or current of the light source to make the brightness of the image of the current frame higher; when the binary coded information is "0", the device can reduce the voltage or current of the light source to make the brightness of the image of the current frame lower.

[0159] It should be understood that the increased brightness value and the decreased brightness value of the light source can be the same. For example, when the binary coded information is "1", the brightness of the light source can be increased to 1.1 times the original value. When the binary coded information is "0", the brightness of the light source can be increased to 0.9 times the original value.

[0160] In this way, the device can adjust the brightness of the light source through current or voltage, so that the display screen can achieve high-frequency brightness and darkness changes without being perceived by the user.

[0161] In the second approach, different display partitions of the device's display screen can transmit different binary coded information. For example, the device can divide the display screen into M display partitions, where M is a positive integer greater than or equal to 2.

[0162] For example, FIG5 is a schematic diagram of different display partitions of a display screen provided by an embodiment of the present application transmitting different binary coded information to the outside.

[0163] Assume that device A divides the display screen into four equal display partitions. Referring to FIG. 5 , the display screen of device A may include display partition 1 , display partition 2 , display partition 3 , and display partition 4 .

[0164] Assuming that the device connection information is the pairing code "656579", the device can first convert the pairing code into the corresponding binary code information "0110 0101 0110 0101 0111 1001".

[0165] For example, for the number 6 in the pairing code, its corresponding binary coded information is "0110". Then, according to the binary coded information "0110", device A can control the light source of the backlight layer corresponding to display partition 1 to turn off, control the light source of the backlight layer corresponding to display partition 2 to turn on, control the light source of the backlight layer corresponding to display partition 3 to turn on, and control the light source of the backlight layer corresponding to display partition 4 to turn off. In this case, display partition 1 can transmit binary coded information "0" to the outside, display partition 2 can transmit binary coded information "1" to the outside, display partition 3 can transmit binary coded information "1" to the outside, and display partition 4 can transmit binary coded information "0" to the outside, so that the entire display screen can transmit binary coded information "0110" to the outside.

[0166] For the number 5 in the pairing code, its corresponding binary coded information is "0101". Then, device A can control the light source of the backlight layer corresponding to display partition 1 to turn off, control the light source of the backlight layer corresponding to display partition 2 to turn on, control the light source of the backlight layer corresponding to display partition 3 to turn off, and control the light source of the backlight layer corresponding to display partition 4 to turn on according to the binary coded information "0101". In this case, display partition 1 can transmit binary coded information "0", display partition 2 can transmit binary coded information "1", display partition 3 can transmit binary coded information "0", and display partition 4 can transmit binary coded information "1", so that the entire display screen can transmit binary coded information "0101".

[0167] It should be understood that device A can process other numbers in the pairing code in the same manner.

[0168] When a user wishes to connect devices, for example, if the user wishes to use device B to establish a connection with device A, device B may, based on the user's first operation, invoke a camera to scan or capture multiple frames of images displayed on the display screen of device A. Device B may then perform signal processing on the acquired multiple frames of images, identify each display partition of the display screen individually or as a whole, identify the binary coded information therein, and further determine the corresponding pairing code based on the binary coded information. Device B may then send a pairing request to device A based on the pairing code to establish the device connection.

[0169] In this case, device B may include a processing module capable of performing the aforementioned signal processing, and the processing module may process the images of the display screen's various display partitions in a certain order to identify the corresponding binary coded information. For example, the processing module may identify the corresponding binary coded information in the order of display partition 1, display partition 2, display partition 3, and display partition 4.

[0170] In another example, assuming the pairing code is "656579", the binary coded information corresponding to the pairing code is "0110 0101 0110 0101 0111 1001", then display partition 1 can be used to transmit the binary coded information "0110 01", display partition 2 can be used to transmit the binary coded information "01 0110", display partition 3 can be used to transmit the binary coded information "0101 01", and display partition 4 can be used to transmit the binary coded information "11 1001". Device B may call upon the camera to scan or capture multiple frames of images displayed on the display screen of device A according to the user's first operation. Afterwards, device B may perform signal processing on the acquired multiple frames of images, identify the binary coded information transmitted in each display partition, and concatenate the corresponding binary coded information in the order of display partition 1, display partition 2, display partition 3, and display partition 4 to obtain "0110 0101 0110 0101 0111 1001", and convert it into the number "656579". Afterwards, device B may send a pairing request to device A according to the pairing code to establish device connection.

[0171] In another example, device A may use one of the multiple display partitions to transmit the binary-coded information corresponding to the pairing code, while the other display partitions transmit other information. For example, device A may use display partition 1 to transmit the binary-coded information corresponding to the pairing code, and use display partitions 2, 3, and 4 to transmit other information, such as the name and configuration information of device A. Alternatively, one or more of display partitions 2, 3, and 4 may not transmit any information, and this is not limited in this embodiment of the present application.

[0172] In this way, since different display partitions of the display screen can transmit different binary coded information, the entire display screen can transmit more data, for example, information such as a pairing code and a device name can be transmitted.

[0173] It can be understood that Figure 5 uses the example of the device's display screen being divided into four different display partitions, but the embodiment of the present application does not limit the specific number M of the display partitions. When M is other values, its technical solution can refer to the relevant description in Figure 5.

[0174] In other examples, the sum of the areas of display partitions 1, 2, 3, and 4 may be 1 / N of the display screen area, where N is a positive integer greater than 1. In this case, the embodiments of the present application do not limit the specific location distribution of the multiple display partitions on the display screen. For example, the multiple display partitions may be located in the middle of the display screen, or in a corner of the display screen.

[0175] It should be understood that the above-mentioned display screen is described by taking the example of vertical division into display partition 1, display partition 2, display partition 3 and display partition 4. In other examples, the display screen can also be divided into display partition 1, display partition 2, display partition 3 and display partition 4 in a horizontal or oblique manner.

[0176] In other examples, device A may also divide the display screen into multiple display partitions in other equal divisions. FIG6 is a schematic diagram of different display partitions of another display screen provided by an embodiment of the present application transmitting different binary coded information.

[0177] As shown in Figure 6 , device A can also divide the display screen into four equal display partitions based on corner division. Partition 1 is located in the upper left corner of the display screen, partition 2 is located in the upper right corner of the display screen, partition 3 is located in the lower left corner of the display screen, and partition 4 is located in the lower right corner of the display screen. Each display partition can transmit a binary coded message.

[0178] Assuming the device connection information is a pairing code, the device can first convert the pairing code into corresponding binary coded information. The manner in which device A controls the brightening or dimming of each display partition based on this binary coded information, as well as the manner in which each display partition transmits different binary coded information, can be found in the previous description and will not be repeated here for the sake of brevity.

[0179] In this case, device B may include a processing module capable of performing the aforementioned signal processing, and the processing module may process the images of the display screen's various display partitions in a certain order to identify the corresponding binary coded information. For example, the processing module may identify the corresponding binary coded information in the order of display partition 1, display partition 2, display partition 3, and display partition 4.

[0180] In mode 3, device A can control the brightness or darkness of the image displayed on the display screen to transmit binary coded information. Figure 7 is a schematic diagram of transmitting different binary coded information by displaying an image in a bright or dark manner, as provided by an embodiment of the present application.

[0181] 7 , device A can adjust the brightness of the displayed image according to the binary coded information, and transmit the binary coded information by displaying the image in a bright or dark manner.

[0182] For binary coded information "0", device A can reduce the brightness of the image based on the original display image; for binary coded information "1", device A can increase the brightness of the image based on the original display image to achieve light and dark changes.

[0183] Let's continue with the example of the device connection information being the pairing code, and the pairing code being "656579." For the number 6, its corresponding binary code is "0110." For the T-th frame image that begins transmitting the binary code "0," device A can reduce the brightness of the pixels in the T-th frame image slightly, with the reduced brightness value being less than a threshold. In this case, the human eye cannot discern the change in brightness. For the T+1 and T+2 frames image that transmit the binary code "1," device A can increase the brightness of the pixels in the T+1 and T+2 frames image by the same amount as the brightness reduction in the T-th frame. Similarly, for the T+3 frame image that transmits the binary code "0," device A can reduce the brightness of the pixels in the T-th frame image slightly. Device A can then continue transmitting other numbers in the same manner.

[0184] It should be understood that before the T-th frame image, multiple consecutive frames of marker frames with the same brightness may also be included. For details, please refer to the relevant description in the above text, which will not be repeated for the sake of brevity.

[0185] It should be understood that the manner in which device B obtains binary coded information by acquiring multiple frames of images displayed by device A can be referred to the relevant description above.

[0186] In other examples, when device A increases or decreases the brightness of an image according to binary coded information, it may increase or decrease the brightness of the entire image, or may increase or decrease the brightness of part of the image, which is not limited in the embodiments of the present application.

[0187] In other examples, multiple original images may be included between the T-th frame image and the T+1-th frame image, the T+1-th frame image and the T+2-th frame image, and the T+2-th frame image and the T+3-th frame image, which are not limited in the embodiments of the present application. In this case, device A does not need to process each frame of the image, thereby reducing the encoding overhead of device A and lowering the power consumption of device A.

[0188] FIG8 is a schematic interaction diagram of a device connection method provided by an embodiment of the present application. As shown in FIG8 , the method 800 is applied to a first device and a second device, and the method 800 may include steps 810 to 860.

[0189] 810. When the second device detects that a trigger condition is met, the second device converts the device connection information of the second device into binary coded information. The device connection information is used to establish a connection relationship between the second device and the first device.

[0190] Exemplarily, the triggering conditions may include at least one of the following conditions: the second device is a vehicle, and one side door of the vehicle is closed (such as the passenger seat); there is someone in the passenger seat; the distance between the second device and the first device is less than or equal to a preset distance, etc.

[0191] The device connection information may include at least one of a connection pairing code of the second device, a product serial number of the second device, or a media access control (MAC) address of the second device.

[0192] For example, if the device connection information is the connection pairing code “656579”, the binary code information converted from the device connection information is “0110 0101 0110 0101 0111 1001”.

[0193] 820. The second device controls the display screen of the second device to change brightness according to the binary coded information.

[0194] The second device can control the display screen to change brightness based on the binary coded information. For example, for the binary coded information "1", the display screen can be bright, and for the binary coded information "0", the display screen can be dimmed. Alternatively, for the binary coded information "1", the display screen can display normally, and for the binary coded information "0", the display screen can be turned off.

[0195] In this way, the second device can control the brightness and darkness of the display screen to transmit binary coded information.

[0196] In other examples, the second device may also convert the device connection information into binary coded information without detecting whether the trigger condition is met, and control the display screen to change brightness according to the binary coded information.

[0197] It can be understood that the light and dark changes in the implementation of this application can also be called light and dark changes, brightness changes, etc.

[0198] 830. The first device detects a first operation and obtains multiple frames of images displayed by the second device through a camera.

[0199] Optionally, the first device and the second device may be in the same local area network, or the first device and the second device may log in to the same account (such as a Huawei account).

[0200] The first operation may be an operation that triggers the first device to connect to the device. For example, the first operation may be an operation of clicking the scan sub-function or the slow motion sub-function in the camera application; or the first operation may be an operation of the user sliding from a fixed area of ​​the display screen of the first device, for example, the first operation is an operation of the user sliding from a corner of the display screen along a certain angle; or, the control center of the drop-down menu bar of the first device includes a shortcut function button, and the first operation may be an operation of the user clicking the function button; or, the lock screen interface of the first device includes a shortcut button, and the first operation may be an operation of the user clicking the shortcut button. The embodiments of the present application do not limit the specific form of the first operation.

[0201] 840. The first device determines binary coded information through multiple frames of images, where the binary coded information includes device connection information of the second device.

[0202] In some examples, the first device may perform signal processing on the entirety of the multiple frames of images to determine brightness and darkness variation information in the multiple frames of images, and determine binary coded information based on the brightness and darkness variation information.

[0203] In other examples, the first device may also perform signal processing on a portion of the multiple image frames to determine brightness variation information for the portion of the multiple image frames, and determine binary coded information based on the brightness variation information. In this way, the first device can establish a device connection without having to obtain an image of the entire display screen of the second device, thereby improving the convenience of device connection.

[0204] In other examples, the first device can also obtain multiple frames of images of multiple display partitions of the display screen of the second device, and perform signal processing on the multiple frames of images of the multiple display partitions in a preset order, obtain brightness and darkness change information in the multiple frames of images of the multiple display partitions, and determine binary coding information based on the brightness and darkness change information.

[0205] 850. The first device determines device connection information of the second device according to the binary coded information.

[0206] After determining the binary coded information, the first device may decode the binary coded information to obtain corresponding device connection information.

[0207] 860. The first device establishes a connection relationship with the second device according to the device connection information.

[0208] The first device can determine the second device based on the acquired device connection information and further establish a connection relationship with the second device. It should be understood that the technical solution for establishing a connection relationship between the first device and the second device can be found in the relevant description above and will not be repeated here.

[0209] In one embodiment of the present application, the second device can convert the device connection information into binary coded information and control the brightness of the display screen according to the binary coded information; when the first operation is detected, the first device can obtain multiple frames of images of the display screen of the second device through the camera, determine the binary coded information conveyed by the multiple frames of images, and determine the device connection information in the binary coded information, and further establish a connection relationship with the second device based on the device connection information of the second device.

[0210] In this way, when connecting devices, the user only needs to perform the operation to trigger the establishment of the device connection, scan the image on the display screen of the second device through the camera of the first device, and obtain the device connection information indicated by the image to complete the connection between the first device and the second device, thereby shortening the interaction path of the device connection, simplifying the device connection process, and making device connection more convenient.

[0211] In some embodiments, the first device determines binary coded information from multiple frames of images, including:

[0212] The first device performs signal processing on the multiple frames of images to obtain first brightness change information in the multiple frames of images;

[0213] The first device determines binary coded information according to the first brightness change information.

[0214] For example, the signal processing method may be envelope analysis, curve fitting, or the like.

[0215] The brightness change corresponding to the first brightness change information can be achieved by the second device adjusting the brightness of the light source, or the brightness change corresponding to the first brightness change information can be achieved by the second device controlling the light source to turn on or off, or the brightness change corresponding to the first brightness change information can also be achieved by the second device adjusting the brightness value of the pixels of the displayed image.

[0216] Based on the embodiment of the present application, the first device can perform signal processing on the acquired multiple frames of images to determine the first brightness and darkness change information in the image, and determine the binary coding information based on the first brightness and darkness change information, so as to determine the device connection information of the second device.

[0217] In some embodiments, the first device performs signal processing on multiple frames of images to obtain first brightness change information in the multiple frames of images, including:

[0218] The first device identifies a partial area with brightness changes in the multiple frames of image;

[0219] The first device performs signal processing on a partial area in the multiple frames of images to obtain first brightness change information of the partial area.

[0220] For example, the partial area may be an area at a preset position of the multiple frames of images, or the portion may be an area with a preset area or shape at a middle position of the multiple frames of images.

[0221] Based on the embodiment of the present application, the second device can control part of the light sources of the display screen to change brightness according to the binary coded information, so that the first device can perform signal processing on the partial area with brightness changes of the acquired multi-frame images to obtain the corresponding first brightness change information, thereby reducing the amount of data for signal processing while also being able to identify the corresponding binary coded information.

[0222] Alternatively, the partial region can be any region of a predetermined size within the multi-frame image. For example, if the entire image within the multi-frame image undergoes synchronous brightness changes, the second device only needs to obtain a portion of the multi-frame image to obtain the brightness change information and determine the corresponding binary coded information. This can improve the use cases of device connections.

[0223] In some embodiments, the first device obtains multiple frames of images displayed by the second device through a camera, including:

[0224] The first device obtains multiple frames of images of multiple display partitions of the display screen of the second device through a camera;

[0225] The first device determines binary coded information through multiple frames of images, including:

[0226] The first device performs signal processing on the multiple frames of images of the multiple display partitions in a preset order to obtain second brightness change information in the multiple frames of images of the multiple display partitions;

[0227] The first device determines binary coded information according to the second brightness change information.

[0228] For example, referring to Figures 5 and 6 , the display screen of the second device can be divided into multiple display partitions. The preset order can be the order of display partitions 1 to 4. As shown in Figure 5 , display partitions 1 to 4 can transmit the binary coded information "0110" at a time. Alternatively, the preset order can be such that each display partition displays multiple binary coded information. The first device can then concatenate the binary coded information to obtain the final binary coded information.

[0229] Based on the embodiments of the present application, the second device may further divide the display screen into multiple display partitions, and may control the multiple display partitions to change brightness according to the binary coded information in a preset order. In this case, the first device may obtain multiple frames of images of the multiple display partitions, perform signal processing on the multiple frames of images of the multiple display partitions in a preset order, obtain second brightness change information from the multiple frames of images of the multiple display partitions, and further determine the corresponding binary coded information.

[0230] In this case, the binary coded information that can be transmitted by the multiple display partitions has a larger data volume, so that the first device can obtain more data from the multiple frames of images of the multiple display partitions.

[0231] In some embodiments, the first device obtains multiple frames of images displayed by the second device through a camera, including:

[0232] The first device acquires a plurality of frames of images through a slow motion mode of a camera.

[0233] In other examples, the first device may also obtain the above-mentioned multiple frames of images through the normal mode of the camera, which is not limited in the embodiments of the present application.

[0234] In some embodiments, the device connection information includes at least one of a connection pairing code of the second device, a product serial number of the second device, and a media access control (MAC) address of the second device.

[0235] In other examples, the device connection information may also include other information, such as mapping information of the product serial number of the second device, configuration information of the second device, etc.

[0236] In some embodiments, the second device controls the display screen of the second device to change brightness according to the binary coded information, including:

[0237] The second device controls the light source of the backlight layer of the display screen to increase or decrease the brightness according to the binary coded information.

[0238] For example, for binary coded information "1", the second device can increase the current or voltage of the light source of the backlight layer so that the light source increases its brightness; or, for binary coded information "0", the second device can reduce the current or voltage of the light source of the backlight layer so that the light source reduces its brightness.

[0239] This technical solution enables the second device to control the brightness of the display screen according to the binary coded information to transmit the binary coded information to the outside.

[0240] In some embodiments, controlling the display screen of the second device to change brightness according to the binary coded information includes:

[0241] The second controls the light source of the backlight layer of the display screen to light up or turn off according to the binary coded information.

[0242] In the embodiments of the present application, turning on or off a light source is a method of changing the brightness of a display screen. For example, for binary coded information "1", the second device can control the light source of the backlight layer to turn on; for binary coded information "0", the second device can control the light source of the backlight layer to turn off. Thus, the second device can transmit binary coded information by turning on or off the light source.

[0243] This technical solution enables the second device to control the brightness of the display screen according to the binary coded information to transmit the binary coded information to the outside.

[0244] In some embodiments, controlling the display screen of the second device to change brightness according to the binary coded information includes:

[0245] The second device increases or decreases the brightness value of the pixels of the image displayed on the display screen according to the binary coded information.

[0246] For example, for binary coded information "1", the second device can increase the brightness value of the pixels of the displayed image to make the displayed image brighter; for binary coded information "0", the second device can reduce the brightness value of the pixels of the displayed image to make the displayed image brighter.

[0247] This technical solution enables the second device to control the brightness of the display screen according to the binary coded information to transmit the binary coded information to the outside.

[0248] In some embodiments, the display screen of the second device includes a plurality of display partitions, wherein controlling the display screen of the second device to change brightness according to the binary coded information includes:

[0249] The second device controls the plurality of display partitions to change brightness according to the binary coded information in a preset order.

[0250] For example, see the relevant descriptions in FIG. 5 or FIG. 6 . The display screen of the second device can be divided into multiple display partitions. The preset order can be the order of display partitions 1 to 4. As shown in FIG. 5 , the second device can control display partitions 1 to 4 to transmit the binary coded information "0110" at a time. Alternatively, the preset order can be that the second device controls each display partition to display multiple binary coded information. Afterwards, the first device can splice the binary coded information to obtain the final binary coded information.

[0251] Based on the embodiment of the present application, the display screen of the second device can be divided into multiple display partitions, and the second device can control the multiple display partitions to change brightness according to the binary coded information in a preset order. In this way, the second device can transmit more data.

[0252] In some embodiments, controlling the display screen of the second device to change brightness according to the binary coded information includes:

[0253] The second device controls a partial area of ​​the display screen of the second device to change brightness according to the binary coded information.

[0254] Exemplarily, the partial area may be an area at a preset position of the display screen, or the portion may be an area with a preset area or shape at a middle position of the display screen.

[0255] Based on the embodiment of the present application, the second device can also control the brightness and darkness of a partial area of ​​the display screen according to the binary coding information without encoding the entire area of ​​the display screen, thereby reducing the coding overhead of the second device and reducing the power consumption of the second device.

[0256] Figure 9 is a schematic block diagram of a device provided in an embodiment of the present application. As shown in Figure 9, the device 900 may include one or more processors 910; one or more memories 920; and one or more memories 920 storing one or more programs. When the one or more programs are executed by the one or more processors 910, the device connection method described in any of the possible implementations described above is executed.

[0257] In some embodiments, the device 900 may be the first device mentioned above, for example, a smart phone, a tablet computer, etc.

[0258] In other embodiments, the device 900 may be the second device mentioned above, for example, a tablet computer, a smart TV, a car device, a smart home device, etc.

[0259] An embodiment of the present application also provides a system, including the first device and the second device in the above embodiment.

[0260] An embodiment of the present application also provides a chip, which includes a processor and a communication interface, wherein the communication interface is used to receive a signal and transmit the signal to the processor, and the processor processes the signal so that the device connection method described in any possible implementation method described above is executed.

[0261] It is understandable that, in order to implement the above functions, the device includes hardware and / or software modules that perform the corresponding functions. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and software. Whether a function is executed in a hardware or software-driven hardware manner depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of this application.

[0262] In this embodiment, the device can be divided into functional modules according to the above-mentioned method examples. For example, each functional module can be divided according to its function, or two or more functions can be integrated into a single processing module. The above-mentioned integrated modules can be implemented in the form of hardware. It should be noted that the module division in this embodiment is illustrative and only represents a logical functional division. In actual implementation, other division methods may be used.

[0263] This embodiment further provides a device connection apparatus, comprising a module for implementing the device connection method in the above embodiment.

[0264] This embodiment further provides a readable storage medium, which stores instructions. When the instructions are executed on a device, the device executes the above-mentioned related method steps to implement the device connection method in the above-mentioned embodiment.

[0265] This embodiment further provides a program product. When the program product is run on a device, the device is caused to execute the above-mentioned related steps to implement the device connection method in the above-mentioned embodiment.

[0266] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store execution instructions, and when the device is running, the processor can execute the execution instructions stored in the memory to enable the chip to execute the device connection method in the above-mentioned method embodiments.

[0267] Among them, the devices, equipment, readable storage media, program products or chips provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0268] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0269] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0270] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0271] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0272] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0273] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0274] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A method for connecting a device, characterized in that: The method is applied to a first device, and the method includes: Upon detecting the first operation, a plurality of frames of images displayed by the second device are acquired through a camera; Determining binary coded information through the multiple frames of images, wherein the binary coded information includes device connection information of the second device; determining device connection information of the second device according to the binary coded information; A connection relationship is established with the second device according to the device connection information.

2. The method according to claim 1, characterized in that The determining the binary coded information through the multiple frames of images includes: Performing signal processing on the multiple frames of images to obtain first brightness change information in the multiple frames of images; The binary coded information is determined according to the first brightness change information.

3. The method according to claim 2, characterized in that Performing signal processing on the multiple frames of images to obtain first brightness change information in the multiple frames of images includes: Identifying partial regions with light and dark changes in the multiple frames of images; Signal processing is performed on the partial area in the multiple frames of images to obtain first brightness change information of the partial area.

4. The method according to claim 1 or 2, characterized in that: The step of acquiring multiple frames of images displayed by the second device through a camera includes: Acquire, by the camera, a plurality of frames of images of a plurality of display partitions of a display screen of the second device; Wherein, determining the binary coded information through the multiple frames of images includes: Performing signal processing on the multiple frames of images of the multiple display partitions in a preset order to obtain second brightness change information in the multiple frames of images of the multiple display partitions; The binary coded information is determined according to the second brightness change information.

5. The method according to any one of claims 1 to 4, characterized in that The step of acquiring multiple frames of images displayed by the second device through a camera includes: The multiple frames of images are acquired through a slow motion mode of a camera.

6. The method according to any one of claims 1 to 5, characterized in that The device connection information includes at least one of a connection pairing code of the second device, a product serial number of the second device, and a media access control MAC address of the second device.

7. A method for connecting a device, characterized in that: The method is applied to a second device, and the method includes: When it is detected that the trigger condition is met, converting the device connection information of the second device into binary coded information, wherein the device connection information is used for the second device to establish a connection relationship with the first device; The display screen of the second device is controlled to change brightness according to the binary coded information.

8. The method according to claim 7, characterized in that The controlling the display screen of the second device to change brightness according to the binary coded information includes: The light source of the backlight layer of the display screen is controlled to increase or decrease the brightness according to the binary coded information.

9. The method according to claim 7, characterized in that: The controlling the display screen of the second device to change brightness according to the binary coded information includes: The light source of the backlight layer of the display screen is controlled to light up or turn off according to the binary coded information.

10. The method according to claim 7, characterized in that The controlling the display screen of the second device to change brightness according to the binary coded information includes: The brightness value of the pixel of the image displayed on the display screen is increased or decreased according to the binary coded information.

11. The method according to any one of claims 7 to 10, characterized in that: The display screen includes a plurality of display partitions, wherein controlling the display screen of the second device to change brightness according to the binary coded information includes: The plurality of display partitions are controlled to change brightness according to the binary coded information in a preset order.

12. The method according to any one of claims 7 to 10, characterized in that: Controlling the display screen of the second device to change brightness according to the binary coded information includes: Control a partial area of ​​the display screen of the second device to change brightness according to the binary coded information.

13. The method according to any one of claims 7 to 12, characterized in that: The device connection information includes at least one of a connection pairing code of the second device, a product serial number of the second device, and a media access control MAC address of the second device.

14. A device, characterized in that include: one or more processors; One or more memories; the one or more memories store one or more programs, and when the one or more programs are executed by the one or more processors, the method for connecting a device as described in any one of claims 1 to 6 is executed, or the method for connecting a device as described in any one of claims 7 to 13 is executed.

15. A chip, characterized in that: The chip includes a processor and a communication interface, wherein the communication interface is used to receive a signal and transmit the signal to the processor, and the processor processes the signal so that the device connection method described in any one of claims 1 to 6 is executed, or the device connection method described in any one of claims 7 to 13 is executed.

16. A readable storage medium, characterized in that: The readable storage medium stores instructions, and when the instructions are executed on the device, the device connection method according to any one of claims 1 to 6 is executed, or the device connection method according to any one of claims 7 to 13 is executed.

Images