Equipment connection method and equipment

The multi-frame image displayed by the second device is obtained through the camera, the binary encoding information is determined and the connection relationship is established, which solves the problems of long interaction paths and cumbersome steps of the existing device connection method, and realizes convenient device connection.

CN119473966APending Publication Date: 2025-02-18HUAWEI TECH CO LTD

Patent Information

Application Number
CN202311013381.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-08-11
Publication Date
2025-02-18

AI Technical Summary

Technical Problem

The existing device connection method has long interactive paths and cumbersome steps, making it difficult to achieve convenient device connection.

Method used

The multi-frame image displayed by the second device is obtained through the camera, binary encoding information is determined, and a device connection relationship is established based on the information, simplifying the device connection process.

Benefits of technology

Shorten the interactive path of device connection, simplify the device connection process, and make device connection more convenient.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119473966A_ABST
    Figure CN119473966A_ABST
Patent Text Reader

Abstract

The invention provides an equipment connection method and equipment. The method comprises the following steps: when a second device detects that a trigger condition is satisfied, converting device connection information into binary coding information, and controlling a display screen to perform brightness change according to the binary coding information; when the first device detects the first operation, the first device obtains a multi-frame image displayed by the second device through the camera, determines binary coding information through the multi-frame image, determines device connection information of the second device according to the binary coding information, and further establishes a connection relationship with the second device according to the device connection information. According to the technical scheme, the interaction path of equipment connection can be shortened, the process of equipment connection is simplified, and equipment connection is more convenient.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of electronic technology, and more specifically, to a method and a device for connecting devices. Background Art

[0002] Currently, users have more and more devices, and there are often scenarios where device connection is required. For example, the current common method of connecting devices is to scan QR codes. However, this method requires the device to display the QR code on a specific interface through user operation when connecting devices, which makes the interactive path of device connection long and the steps cumbersome.

[0003] Therefore, how to conveniently achieve device connection becomes a technical problem that needs to be solved. Summary of the invention

[0004] The present application provides a method and device for connecting devices. The technical solution can shorten the interactive path of device connection, simplify the process of device connection, and make device connection more convenient.

[0005] In a first aspect, a method for device connection is provided, which is applied to a first device, and includes: detecting a first operation, and acquiring a plurality of frames of images displayed by a second device through a camera; determining binary coded information through the plurality of frames of images, wherein the binary coded information includes device connection information of the second device; determining the device connection information of the second device according to the binary coded information; and establishing a connection relationship with the second device according to the device connection information.

[0006] Based on the embodiments of the present application, when the first device detects a first operation, it can obtain multiple frames of images displayed by the second device through a camera, determine binary coding information through the multiple frames of images, determine the device connection information of the second device based on the binary coding information, and further establish a connection relationship with the second device through the device connection information.

[0007] In this way, when connecting devices, the user only needs to execute the operation to trigger the establishment of the device connection, and then use the camera of the first device to capture or scan the image displayed by the second device and identify the device connection information of the image. The connection between the first device and the second device can be completed through the device connection information, thereby shortening the interaction path of the device connection, simplifying the device connection process, and making device connection more convenient.

[0008] In combination with the first aspect, in an implementation method of the first aspect, determining the binary coded information through the multiple frames of images includes: performing signal processing on the multiple frames of images to obtain first light and dark change information in the multiple frames of images; and determining the binary coded information based on the first light and dark change information.

[0009] Exemplarily, the signal processing method may be envelope analysis, curve fitting, or the like.

[0010] The brightness change corresponding to the first brightness change information can be achieved by the second device adjusting the brightness of the light source, or the brightness change corresponding to the first brightness change information can be achieved by the second device controlling the light source to turn on or off, or the brightness change corresponding to the first brightness change information can also be achieved by the second device adjusting the brightness value of the pixels of the displayed image.

[0011] Based on the embodiment of the present application, the first device can perform signal processing on the acquired multiple frames of images to determine the first brightness change information in the image, and determine the binary coding information based on the first brightness change information, so as to determine the device connection information of the second device.

[0012] In combination with the first aspect, in an implementation method of the first aspect, signal processing is performed on the multiple frames of images to obtain first light and dark change information in the multiple frames of images, including: identifying partial areas with light and dark changes in the multiple frames of images; performing signal processing on the partial areas in the multiple frames of images to obtain first light and dark change information of the partial areas.

[0013] Based on the embodiment of the present application, the second device can control part of the light sources of the display screen to change brightness according to the binary coded information, so that the first device can perform signal processing on the partial area with brightness changes of the acquired multi-frame images to obtain the corresponding first brightness change information, thereby reducing the amount of data for signal processing while also identifying the corresponding binary coded information.

[0014] Optionally, the partial area may also be any area with a preset area in multiple frames of images.

[0015] In combination with the first aspect, in an implementation method of the first aspect, acquiring multiple frames of images displayed by the second device through a camera includes: acquiring multiple frames of images of multiple display partitions of a display screen of the second device through the camera; wherein, determining the binary coded information through the multiple frames of images includes: performing signal processing on the multiple frames of images of the multiple display partitions in a preset order to acquire second light and dark change information in the multiple frames of images of the multiple display partitions; and determining the binary coded information based on the second light and dark change information.

[0016] Based on the embodiment of the present application, the second device can also divide the display screen into multiple display partitions, and can control the multiple display partitions to change brightness according to the binary coded information in a preset order. In this case, the first device can obtain multiple frames of images of the above multiple display partitions, and perform signal processing on the multiple frames of images of the multiple display partitions in a preset order, obtain the second brightness change information in the multiple frames of images of the multiple display partitions, and further determine the corresponding binary coded information.

[0017] In this case, the binary coded information that can be transmitted by the multiple display partitions has a larger data volume, so that the first device can obtain more data from the multiple frames of images of the multiple display partitions.

[0018] In combination with the first aspect, in an implementation manner of the first aspect, acquiring the multiple frames of images displayed by the second device through the camera includes: acquiring the multiple frames of images through a slow motion mode of the camera.

[0019] In other examples, the first device may also acquire the above-mentioned multiple frames of images through the normal mode of the camera, which is not limited in the embodiments of the present application.

[0020] In combination with the first aspect, in an implementation manner of the first aspect, the device connection information includes at least one of a connection pairing code of the second device, a product serial number of the second device, and a media access control MAC address of the second device.

[0021] In other examples, the device connection information may also include other information, such as mapping information of the product serial number of the second device, configuration information of the second device, etc.

[0022] In a second aspect, a method for device connection is provided, which is applied to a second device, and includes: when it is detected that a trigger condition is met, converting device connection information of the second device into binary coded information, and the device connection information is used to establish a connection relationship between the second device and the first device; controlling the display screen of the second device to change brightness according to the binary coded information.

[0023] Based on the embodiment of the present application, when the second device detects that the trigger condition is met, it can convert the device connection information into binary coded information, and control the display screen to change the brightness according to the binary coded information, so that the second device can transmit the binary coded information to the outside, so that other devices can perform the device connection process by simply scanning or capturing multiple frames of images of the display screen of the second device, making device connection more convenient.

[0024] In combination with the second aspect, in an implementation of the second aspect, controlling the display screen of the second device to change brightness according to the binary coded information includes: controlling the light source of the backlight layer of the display screen to increase or decrease brightness according to the binary coded information.

[0025] For example, for binary coded information "1", the second device can increase the current or voltage of the light source of the backlight layer so that the light source increases its brightness; or, for binary coded information "0", the second device can reduce the current or voltage of the light source of the backlight layer so that the light source decreases its brightness.

[0026] This technical solution can enable the second device to control the brightness of the display screen according to the binary coded information to transmit the binary coded information to the outside.

[0027] In combination with the second aspect, in an implementation of the second aspect, controlling the display screen of the second device to change brightness according to the binary coded information includes: controlling the light source of the backlight layer of the display screen to light up or turn off according to the binary coded information.

[0028] For example, for binary coded information "1", the second device may control the light source of the backlight layer to light up; for binary coded information "0", the second device may control the light source of the backlight layer to turn off.

[0029] This technical solution can enable the second device to control the brightness of the display screen according to the binary coded information to transmit the binary coded information to the outside.

[0030] In combination with the second aspect, in an implementation of the second aspect, controlling the display screen of the second device to change brightness according to the binary coded information includes: increasing or decreasing the brightness value of pixels of the image displayed on the display screen according to the binary coded information.

[0031] For example, for binary coded information "1", the second device can increase the brightness value of the pixels of the displayed image to make the displayed image brighter; for binary coded information "0", the second device can reduce the brightness value of the pixels of the displayed image to make the displayed image brighter.

[0032] This technical solution can enable the second device to control the brightness of the display screen according to the binary coded information to transmit the binary coded information to the outside.

[0033] In combination with the second aspect, in an implementation of the second aspect, the display screen includes multiple display partitions, wherein controlling the display screen of the second device to change brightness according to the binary coded information includes: controlling the multiple display partitions to change brightness according to the binary coded information in a preset order.

[0034] Based on the embodiment of the present application, the display screen of the second device can be divided into multiple display partitions, and the second device can control the multiple display partitions to change brightness according to the binary coded information in a preset order. In this way, the second device can transmit more data to the outside.

[0035] In combination with the second aspect, in an implementation of the second aspect, controlling the display screen of the second device to change brightness according to the binary coded information includes: controlling a partial area of ​​the display screen of the second device to change brightness according to the binary coded information.

[0036] Based on the embodiment of the present application, the second device can also control the brightness of a partial area of ​​the display screen according to the binary coding information, thereby reducing the coding overhead of the second device and reducing the power consumption of the second device.

[0037] In a third aspect, a system is provided, the system comprising a first device and a second device, wherein the second device is used to: when determining that a trigger condition is met, convert device connection information of the second device into binary coded information, the device connection information being used for the second device to establish a connection relationship with the first device; and control a display screen of the second device to change brightness according to the binary coded information;

[0038] The first device is used to: detect a first operation and obtain a plurality of frames of images displayed by the second device through a camera; determine the binary coded information through the plurality of frames of images, wherein the binary coded information includes device connection information of the second device; determine the device connection information of the second device according to the binary coded information; and establish a connection relationship with the second device according to the device connection information.

[0039] In a fourth aspect, a device is provided, comprising: one or more processors; one or more memories; the one or more memories storing one or more computer programs, the one or more computer programs comprising instructions, which, when executed by the one or more processors, enable the method for connecting the devices as described in the first aspect and any possible implementation thereof to be executed.

[0040] In a fifth aspect, a device is provided, comprising: one or more processors; one or more memories; the one or more memories storing one or more computer programs, the one or more computer programs comprising instructions, which, when executed by one or more processors, enable the method of connecting the devices as described in the second aspect and any possible implementation thereof to be executed.

[0041] In a sixth aspect, a device connection apparatus is provided, comprising: a module for implementing the device connection method as described in the first aspect and any possible implementation thereof, or the second aspect and any possible implementation thereof.

[0042] In the seventh aspect, a chip is provided, comprising a processor and a communication interface, wherein the communication interface is used to receive a signal and transmit the signal to the processor, and the processor processes the signal so that the device connection method described in the first aspect and any possible implementation thereof is executed.

[0043] In an eighth aspect, a chip is provided, comprising a processor and a communication interface, wherein the communication interface is used to receive a signal and transmit the signal to the processor, and the processor processes the signal so that the method for connecting a device as described in the second aspect and any possible implementation thereof is executed.

[0044] In a ninth aspect, a readable storage medium is provided, wherein instructions are stored in the readable storage medium. When the instructions are executed on a device, the method for connecting a device as described in the first aspect and any possible implementation thereof is executed.

[0045] In a tenth aspect, a readable storage medium is provided, wherein instructions are stored in the readable storage medium. When the instructions are executed on a device, the method for connecting a device as described in the second aspect and any possible implementation thereof is executed.

[0046] In an eleventh aspect, a program product is provided, the program product comprising a program code, and when the program code is run on an electronic device, the device connection method as described in the first aspect and any possible implementation thereof is executed.

[0047] In a twelfth aspect, a program product is provided, the program product comprising a program code, and when the program code is run on an electronic device, the device connection method as described in the second aspect and any possible implementation thereof is executed. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] Figure 1 It is a schematic diagram of the structure of the device provided in the embodiment of the present application.

[0049] Figure 2 It is a schematic diagram of the software structure of the device provided in the embodiment of the present application.

[0050] Figure 3 It is a schematic diagram of a scenario to which the embodiments of the present application can be applied.

[0051] Figure 4 It is a schematic diagram of a display screen provided in an embodiment of the present application, which changes in brightness according to binary coded information.

[0052] Figure 5 It is a schematic diagram of different display partitions of a display screen provided by an embodiment of the present application transmitting different binary coded information to the outside.

[0053] Figure 6 It is a schematic diagram of another display screen provided by an embodiment of the present application, in which different display partitions transmit different binary coded information to the outside.

[0054] Figure 7 It is a schematic diagram provided by an embodiment of the present application for transmitting different binary coded information externally through bright display or dark display of an image.

[0055] Figure 8 It is a schematic interactive diagram of a method for connecting devices provided in an embodiment of the present application.

[0056] Fig. 9 It is a schematic block diagram of a device proposed in an embodiment of the present application. DETAILED DESCRIPTION

[0057] The technical solution in this application will be described below in conjunction with the accompanying drawings.

[0058] The device connection method in the embodiments of the present application can be applied to smart phones, displays, smart TVs, tablet computers, laptops, personal computers (PCs), ultra-mobile personal computers (UMPCs), netbooks, vehicle-mounted devices, car computers, wearable devices, foldable devices, Internet of Things (IOT) devices with display screens, and other devices.

[0059] Figure 11 shows a schematic diagram of the structure of the device 100. The device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0060] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the device 100. In other embodiments of the present application, the device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0061] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0062] In the present application, the processor 110 may be used to encode and decode an image. For example, the processor 110 in one device may be used to change the brightness of a display screen according to binary coded information, where the binary coded information includes device connection information of the device. The processor in another device may be used to identify the device connection information from an acquired image.

[0063] The controller may be the nerve center and command center of the device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0064] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0065] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus interface, etc.

[0066] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL).

[0067] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170.

[0068] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface.

[0069] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160.

[0070] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193 .

[0071] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc.

[0072] The USB interface 130 is an interface that complies with USB standard specifications, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 may be used to connect a charger to charge the device 100, and may also be used to transmit data between the device 100 and a peripheral device.

[0073] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the device 100. In other embodiments of the present application, the device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0074] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input through the wireless charging coil of the device 100. While the charging management module 140 is charging the battery 142, it can also power the device through the power management module 141.

[0075] The power management module 141 is used to connect the battery 142 , the charging management module 140 and the processor 110 .

[0076] The wireless communication function of the device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0077] The mobile communication module 150 can provide wireless communication solutions including 2G / 3G / 4G / 5G etc. applied on the device 100 .

[0078] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0079] The wireless communication module 160 can provide wireless communication solutions applied to the device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), Bluetooth low energy (BLE), global navigation satellite system (GNSS), frequency modulation (FM), nearfield communication technology (NFC), infrared technology (IR), etc.

[0080] In some embodiments, antenna 1 of device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that device 100 can communicate with the network and other devices through wireless communication technology.

[0081] The device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0082] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), or a display panel made of one of the materials such as an organic light-emitting diode (OLED), an active matrix organic light-emitting diode or an active matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed or a quantum dot light emitting diode (QLED). In some embodiments, the device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0083] In the embodiment of the present application, the device 100 can display an image through the display screen 194, and display an image superimposed with digital watermark information.

[0084] The device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0085] The ISP is used to process the data fed back by the camera 193. The camera 193 is used to capture a static image or a video. In the present application, the camera 193 can be used to obtain an image displayed on a display screen of another device.

[0086] Digital signal processors are used to process digital signals. In addition to processing digital image signals, they can also process other digital signals.

[0087] The video codec is used to compress or decompress digital video. The device 100 may support one or more video codecs.

[0088] The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the device 100 .

[0089] The internal memory 121 may be used to store computer executable program codes, wherein the executable program codes include instructions. The processor 110 executes various functional applications and data processing of the device 100 by running the instructions stored in the internal memory 121 .

[0090] The device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0091] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals.

[0092] The speaker 170A, also called a "horn", is used to convert audio electrical signals into sound signals.

[0093] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals.

[0094] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.

[0095] The earphone jack 170D is used to connect a wired earphone.

[0096] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194 .

[0097] The gyro sensor 180B may be used to determine the motion posture of the device 100 .

[0098] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

[0099] The acceleration sensor 180E can detect the magnitude of the acceleration of the device 100 in various directions (generally three axes).

[0100] The distance sensor 180F is used to measure the distance.

[0101] The fingerprint sensor 180H is used to collect fingerprints.

[0102] The touch sensor 180K is also called a “touch panel.” The touch sensor 180K may be disposed on the display screen 194 , and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen.”

[0103] The bone conduction sensor 180M can obtain vibration signals. In some embodiments, the bone conduction sensor 180M can obtain vibration signals of vibrating bones of the human body. The bone conduction sensor 180M can also contact the human body's pulse to receive blood pressure beating signals.

[0104] Buttons 190 include a power button, a volume button, and the like.

[0105] Motor 191 can generate vibration prompts.

[0106] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0107] The SIM card interface 195 is used to connect a SIM card.

[0108] The software system of the device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes an operating system of a layered architecture as an example to exemplify the software structure of the device 100.

[0109] Currently, users have more and more devices, and there are often scenarios where device connection is required. For example, the current common method of connecting devices is to scan QR codes. However, this method requires the device to display the QR code on a specific interface through user operation when connecting devices, which makes the interactive path of device connection long and the steps cumbersome.

[0110] In view of this, the embodiment of the present application provides a method and device for device connection. In the technical solution, device A can convert device connection information used for device connection into binary coded information, and when displaying an image, control the display screen to display light or dark according to the binary coded information, or control the display screen to light up or turn off, so as to transmit the binary coded information; another device B can obtain multiple frames of images displayed by device A through a camera to obtain the binary coded information therein, and determine the device connection information according to the binary coded information, and further establish a connection relationship with device A.

[0111] This technical solution can trigger the pairing connection between device A and device B by allowing the user to scan multiple frames of images displayed by device A and determine the device connection information through the camera of device B after executing the operation to trigger the establishment of the device connection. This can shorten the interaction path of the device connection, simplify the device connection process, and make device connection more convenient.

[0112] For example, Figure 3 Schematic diagram of a scenario to which the present application embodiment can be applied. Figure 3 As shown, the connection relationship between the mobile phone 200b and other devices is established as an example for explanation.

[0113] See also Figure 3In (a), the scene may include a vehicle 200a and a mobile phone 200b. The cockpit of the vehicle 200a may include an instrument screen 201, a display screen 202 (or, it may also be referred to as a central control screen), a display screen 203 (or, it may also be referred to as a passenger entertainment screen), a display screen 204 (or, it may also be referred to as an entertainment screen in the left area of ​​the second row), and a display screen 205 (or, it may also be referred to as an entertainment screen in the right area of ​​the second row).

[0114] In one example, the vehicle 200a may convert the device connection information of the vehicle 200a into binary coded information, and when the display screen 203 displays an image, control the display screen 203 to display the image brightly or darkly according to the binary coded information.

[0115] For example, when the display screen 203 displays wallpaper A, the vehicle 200a can control the display screen 203 to display wallpaper A1 with a higher brightness than the original wallpaper A in one frame, and to display wallpaper A2 with a lower brightness than the original wallpaper A in the next frame, and then to display wallpaper A1 in the next frame, and then to display wallpaper A2 in the next frame, and so on. In this way, it can be understood that the display screen 203 switches between light and dark for a preset number (e.g., 300) times per second, and the wallpaper A1 with high brightness displayed on the display screen 203 can represent the coded information "1", and the wallpaper A2 with low brightness displayed on the display screen 203 can represent the coded information "0", so that the display screen 203 can transmit binary coded information to the outside through the change of light and dark. When the user uses the camera of the mobile phone 200b to scan or shoot the multiple frames of images displayed on the display screen 203, the acquired multiple frames of images can be subjected to signal analysis to identify the binary coded information therein, and the device connection information of the vehicle 200a can be determined through the binary coded information. Thus, the mobile phone 200b can establish a connection relationship with the vehicle 200a.

[0116] It should be understood that the content of wallpaper A, wallpaper A1 and wallpaper A2 are the same, but the brightness is different.

[0117] For another example, when the display screen 203 displays wallpaper A, the vehicle 200a can control the display screen 203 to display wallpaper A for one frame, turn off the display screen for the next frame, display wallpaper A for the next frame, turn off the display screen for the next frame, and so on. In this way, it can be understood that the display screen 203 switches between lighting and extinguishing a preset number (e.g., 300) times per second, and the display screen 203 lighting up can represent the coded information "1", and the display screen 203 extinguishing can represent the coded information "0", so that the display screen 203 can transmit binary coded information to the outside through the change of light and dark. It should be understood that "bright" here can be understood as the display screen lighting up and displaying images normally, and "dark" can be understood as the display screen extinguishing and not displaying any image.

[0118] The device connection information may be one or more of a pairing code, a product serial number, a media access control (MAC) address, a device model information, a device name, or a device configuration information, etc. Alternatively, it may be a mapping of the above information. For example, since the product serial number of a device is generally 15 digits, in order to reduce the coding overhead, the device identification information may also be a mapping of the product serial number of the device, for example, mapping the product serial number of the device into a 6-digit or 8-digit number.

[0119] In the following, the mobile phone 200b is connected to the vehicle 200a through Bluetooth, and the device connection information is a pairing code. For example, the pairing code may include 6 digits, such as 656579, and the binary code information corresponding to the pairing code is "0110 0101 0110 01010111 1001", and the binary code information "0" indicates dark display, and the binary code information "1" indicates bright display. Then the display screen 203 can display the image brightly or darkly according to the binary code information, and the vehicle 200a can control the display screen 203 to display in a loop according to the binary code information "0110 0101 0110 0101 0111 1001". At the same time, the vehicle 200a can also broadcast a Bluetooth message to the outside, and the Bluetooth message can carry the above-mentioned device connection information of the vehicle 200a. The mobile phone 200b can obtain multiple frames of images of the display screen 203 through a camera, further perform signal analysis on the multiple frames of images to determine the binary code information, and determine the corresponding device connection information according to the binary code information. At the same time, the mobile phone 200b scans the Bluetooth message of the vehicle 200a, and determines that the device to be connected is the vehicle 200a according to the acquired device connection information, so that the mobile phone 200b can perform Bluetooth pairing with the vehicle 200a to establish a Bluetooth communication connection.

[0120] Because the display screen 203 can change at a preset frequency (such as 300) times per second, the change speed is fast and beyond the recognition range of the human eye, and the user's eyes cannot perceive the change in brightness of the display screen 203. Therefore, from the user's point of view, the display screen 203 displays images normally, but can also connect devices, thus giving the user a good sense of technology and experience.

[0121] It is understandable that the display screen 203 of the vehicle 200a can always display images in the above manner, so that the user can scan or shoot the image displayed on the display screen 203 at any time through the mobile phone 200b to connect the device, thereby improving the efficiency of device connection and user experience.

[0122] In other examples, when the vehicle 200a detects that the trigger condition is met, it will control the display screen 203 to display the image in the above display manner, thereby saving device power consumption to a certain extent.

[0123] The trigger condition may be at least one of the following: the vehicle door on the side of the display screen 203 is closed; there is someone on the seat where the display screen 203 is located; the distance between the mobile phone 200b and the display screen 203 is less than or equal to a preset distance, etc.

[0124] It should be understood that in the embodiment of the present application, the display screen 203 of the vehicle 200a displays images in the above display mode as an example for explanation, but this should not limit the present application. In other examples, other display screens in the vehicle 200a can also display images in the above display mode, which is not limited in the embodiment of the present application.

[0125] In this application, this technical solution can also be applied to the device connection solution in the home scene, see Figure 3 In (b), the user's home may include devices such as smart TV 300a, smart TV 300b, smart TV 300c, PC 300d and tablet 300e.

[0126] Smart TV 300a, smart TV 300b, smart TV 300c, PC 300d and tablet 300e can display images in the above-mentioned display mode, or can also display images in the above-mentioned display mode when detecting that the above-mentioned trigger conditions are met, so that when the user wants to establish a device connection, he can scan or shoot the image displayed by the device through the mobile phone 200b to connect the device. This technical solution can shorten the interactive path of device connection, simplify the process of device connection, and make device connection more convenient.

[0127] Exemplarily, when mobile phone 200b and smart TV 300c are in the same local area network or logged in to the same Huawei account, and the device connection information is the pairing code, product serial number or MAC address of the device, after mobile phone 200b obtains the device connection information of smart TV 300c, it can obtain the pairing code, product serial number or MAC address of smart TV 300c from the device connection information, so that mobile phone 200b can establish a connection relationship with smart TV 300c.

[0128] Alternatively, when mobile phone 200b and smart TV 300c are in the same local area network or logged in to the same Huawei account, when the device connection information is a digital number mapped to the product serial number of smart TV 300c, after mobile phone 200b obtains the device connection information of smart TV 300c, it can obtain the digital number mapped to the product serial number of smart TV 300c from the device connection information, and further identify smart TV 300c based on the digital number, so that mobile phone 200b can establish a connection relationship with smart TV 300c.

[0129] In the above implementation, the entire display screen of the device can be synchronously bright or dark according to the binary code information, so that when the device is connected, as long as the mobile phone 200b can scan or capture part of the display screen, it can obtain the binary code information and determine the device connection information, trigger the connection pairing and connect the device. Therefore, even if the display screen is partially blocked, the device connection can still be conveniently performed, which increases the scope of use of the device connection.

[0130] In the embodiment of the present application, there are several ways in which the device controls the display screen to display light or dark according to binary coded information.

[0131] Method 1: The device controls the display screen to display bright or dark synchronously according to the binary coded information.

[0132] Method 2: The device controls the display screen to light up or darken the display in different areas according to the binary coded information.

[0133] Method three: The device controls the brightness of the image displayed on the display screen to display bright or dark according to the binary coded information.

[0134] Specifically, in an example of method one, the device can control the lighting of the display screen by lighting up the light source of the backlight layer of the display screen, and control the extinguishing of the display screen by extinguishing the light source of the backlight layer of the display screen. In this technical solution, lighting up the display screen can be understood as bright display, and extinguishing the display screen can be understood as dark display. The lighting or extinguishing of the display screen depends on the light source of the backlight layer of the display screen. When the light source is lit, the display screen is in a lit state; when the light source is extinguished, the display screen is in an extinguished state. The device can control the light source of the backlight layer to light up or extinguish according to the binary coded information to realize the lighting or extinguishing of the display screen.

[0135] For example, for a binary number "1", the light source is controlled to light up so that the display screen is lit; for a binary number "0", the light source is controlled to turn off so that the display screen is turned off.

[0136] It can be understood that lighting the light source can also be understood as the light source emitting light.

[0137] For example, Figure 4It is a schematic diagram of a display screen provided in an embodiment of the present application, which changes in brightness according to binary coded information.

[0138] Before the device displays an image, the device needs to convert the device connection information into binary coded information. For example, if the device connection information is a pairing code, the device may first convert the pairing code into corresponding binary coded information.

[0139] See also Figure 4 For example, for the number 6 in the pairing code, the corresponding binary code information is "0110", then device A can control the light source of the backlight layer to emit light or extinguish according to the binary code information "0110", and specifically, the light source can execute the sequence of "extinguish-light-maintain light-extinguish" to transmit the binary code information "0110" to the outside. For the number 5 in the pairing code, the corresponding binary code information is "0101", then device A can control the light source of the backlight layer to emit light or extinguish according to the binary code information "0101", and specifically, the light source can execute the sequence of "extinguish-light-extinguish-light" to transmit the binary code information "0101" to the outside. It should be understood that for other numbers in the pairing code, device A can process them in the same way.

[0140] It should be understood that the light source of the backlight layer here being “off” or “on” may be the state of the light source in one frame.

[0141] Exemplarily, device A can turn on and off the light source by adjusting the switch of the backlight layer light source.

[0142] When the user wishes to connect devices, for example, the user wishes to use device B to establish a connection with device A. Device B may call a camera to scan or capture multiple frames of images displayed on the display screen of device A according to the user's first operation, and then device B may perform signal processing on the acquired multiple frames of images to identify binary coded information therein, and further determine the corresponding pairing code according to the binary coded information; then, device B may send a pairing request to device A according to the pairing code to connect the devices.

[0143] It is understandable that in order to enable device B to obtain the correct binary coded information, device A can control the light source of the backlight layer to change brightness in a cycle according to the binary coded information. Before each cycle, device A can control the brightness of a preset number of consecutive frames to be the same to serve as a mark. In this way, when device B performs signal processing on the acquired multiple frames of images, it can start to identify from the frame after the mark to accurately obtain the corresponding binary coded information. For example, if the pairing code is a 6-digit number, then the binary coded information is the binary coded information corresponding to the 6-digit number. Before controlling the light source of the backlight layer to change brightness in a cycle according to the binary coded information each time, device A first controls the light source of the backlight layer to light up for 3 consecutive frames or turn off for 3 consecutive frames to serve as a mark. The above-mentioned preset number can also be other values, such as 4. The specific value of the preset number is not limited in the embodiment of the present application.

[0144] Exemplarily, the method in which device B performs signal processing on the acquired multi-frame image sequence may be envelope analysis, curve fitting, etc., and the embodiment of the present application does not limit the specific method of the signal processing.

[0145] Taking envelope analysis as an example of signal processing, after envelope analysis is performed on the acquired multiple frames of images, the corresponding envelope spectrum can be obtained, so that the corresponding binary coding information can be further determined.

[0146] The first operation may be an operation of clicking the scan subfunction or the slow motion subfunction in the camera application; or, the first operation may be an operation of the user sliding from a fixed area of ​​the display screen of device B, for example, the first operation is an operation of the user sliding along a certain angle starting from a corner of the display screen; or, there is a shortcut function button in the control center of the drop-down menu bar of device B, and the first operation may be an operation of the user clicking the function button.

[0147] In the embodiment of the present application, the device connection information is a pairing code as an example for explanation. In other examples, when the device connection information is information such as a product serial number, a MAC address or a device model information, the device can be processed in the same way, and for the sake of brevity, it is not repeated here.

[0148] Since the light source of the backlight layer of the display can change at a preset frequency (such as 300 or 150 times) per second, when the light source changes brightness according to the binary coded information, its frequency of change can exceed the recognition range of the human eye. The frequency of change here can be understood as the number of frames included in the light source per second. In this way, the user can not perceive the brightness change of the display. This device connection method is both convenient and can improve the user experience.

[0149] It is understandable that the entire display screen of device A may be synchronously lit or extinguished according to the binary coded information, or part of the display screen of device A may be synchronously lit or extinguished according to the binary coded information.

[0150] Exemplarily, device A may also control a display area of ​​a preset area or a preset shape in the middle part of the display screen to light up or turn off according to binary coded information, while the rest of the display screen is displayed normally.

[0151] For example, the preset area is 1 / N of the area of ​​the display screen, where N is a positive integer greater than 1. The preset shape is a circle or a rectangle.

[0152] Alternatively, device A can control a display area of ​​a preset area in the upper left corner, upper right corner, lower left corner, or lower right corner of the display screen to light up or go out according to binary coded information, such as the preset area is 1 / N of the area of ​​the display screen, where N is a positive integer greater than 1.

[0153] When part of the display screen of device A is synchronously lit or extinguished according to binary coded information, when connecting the devices, only by scanning the image of a specific display area can the devices be paired and connected, thereby enhancing the technological sense of the device connection.

[0154] In some other examples of the first method, the device A can also achieve bright or dark display on the display screen by adjusting the voltage or current of the light source of the backlight layer.

[0155] Among them, when the voltage of the backlight layer light source is high or the current is large, the brightness of the light source is high, and the image displayed on the display screen is brighter; when the voltage of the backlight layer light source is low or the current is small, the brightness of the light source is low, and the image displayed on the display screen is darker.

[0156] For example, when the binary coded information is "1", the device can increase the voltage or current of the light source to make the brightness of the image of the current frame higher; when the binary coded information is "0", the device can reduce the voltage or current of the light source to make the brightness of the image of the current frame lower.

[0157] It should be understood that the increased brightness value and the decreased brightness value of the light source can be the same. For example, when the binary coded information is "1", the brightness of the light source can be increased to 1.1 times the original value. When the binary coded information is "0", the brightness of the light source can be increased to 0.9 times the original value.

[0158] In this way, the device can adjust the brightness of the light source through current or voltage, so that the display screen can achieve high-frequency brightness changes without being perceived by the user.

[0159] In the second mode, different display partitions of the display screen of the device can transmit different binary coded information to the outside. Exemplarily, the device can divide the display screen into M display partitions, where M is a positive integer greater than or equal to 2.

[0160] For example, Figure 5 It is a schematic diagram of different display partitions of a display screen provided by an embodiment of the present application transmitting different binary coded information to the outside.

[0161] Assume that device A divides the display screen into four equal display partitions. Figure 5 , the display screen of device A may include display partition 1, display partition 2, display partition 3 and display partition 4.

[0162] Assuming that the device connection information is the pairing code "656579", the device may first convert the pairing code into the corresponding binary encoding information "0110 0101 0110 0101 0111 1001".

[0163] For example, for the number 6 in the pairing code, the corresponding binary coded information is "0110", then device A can control the light source of the backlight layer corresponding to display partition 1 to turn off, control the light source of the backlight layer corresponding to display partition 2 to turn on, control the light source of the backlight layer corresponding to display partition 3 to turn on, and control the light source of the backlight layer corresponding to display partition 4 to turn off according to the binary coded information "0110". In this case, display partition 1 can transmit binary coded information "0" to the outside, display partition 2 can transmit binary coded information "1" to the outside, display partition 3 can transmit binary coded information "1" to the outside, and display partition 4 can transmit binary coded information "0" to the outside, so that the entire display screen can transmit binary coded information "0110" to the outside.

[0164] For the number 5 in the pairing code, the corresponding binary code information is "0101", then device A can control the light source of the backlight layer corresponding to display partition 1 to turn off, control the light source of the backlight layer corresponding to display partition 2 to turn on, control the light source of the backlight layer corresponding to display partition 3 to turn off, and control the light source of the backlight layer corresponding to display partition 4 to turn on according to the binary code information "0101". In this case, display partition 1 can transmit binary code information "0" to the outside, display partition 2 can transmit binary code information "1" to the outside, display partition 3 can transmit binary code information "0" to the outside, and display partition 4 can transmit binary code information "1" to the outside, so that the entire display screen can transmit binary code information "0101" to the outside.

[0165] It should be understood that device A can process other numbers in the pairing code in the same manner.

[0166] When the user wishes to connect devices, for example, the user wishes to use device B to establish a connection with device A. Then, device B may call the camera to scan or capture multiple frames of images displayed on the display screen of device A according to the user's first operation, and then device B may perform signal processing on the acquired multiple frames of images, identify each display partition of the display screen separately or as a whole, so as to identify the binary coded information therein, and further determine the corresponding pairing code according to the binary coded information; then, device B may send a pairing request to device A according to the pairing code to connect the devices.

[0167] In this case, the device B may include a processing module capable of performing the above-mentioned signal processing, and the processing module may perform signal processing on the images of each display partition of the display screen in a certain order to identify the corresponding binary coded information. For example, the processing module identifies the corresponding binary coded information in the order of display partition 1, display partition 2, display partition 3, and display partition 4.

[0168] In another example, assuming that the pairing code is "656579", the binary coded information corresponding to the pairing code is "0110 0101 01100101 0111 1001", then display partition 1 can be used to transmit binary coded information "011001", display partition 2 can be used to transmit binary coded information "01 0110", display partition 3 can be used to transmit binary coded information "0101 01", and display partition 4 can be used to transmit binary coded information "11 1001". Device B can call the camera to scan or shoot multiple frames of images displayed on the display screen of device A according to the user's first operation. After that, device B can perform signal processing on the acquired multiple frames of images, and identify the binary coded information transmitted in each display partition, and splice the corresponding binary coded information in the order of display partition 1, display partition 2, display partition 3 and display partition 4 to obtain "0110 0101 0110 0101 0111 1001", and convert it into the number "656579"; after that, device B can send a pairing request to device A according to the pairing code to connect the devices.

[0169] In another example, device A may also use one of the multiple display partitions to transmit the binary coded information corresponding to the pairing code, and other display partitions to transmit other information. For example, device A may use display partition 1 to transmit the binary coded information corresponding to the pairing code, and use display partition 2, display partition 3, and display partition 4 to transmit other information, such as the name and configuration information of device A. Alternatively, one or more of display partition 2, display partition 3, and display partition 4 may not transmit information, and the embodiments of the present application are not limited to this.

[0170] In this way, since different display partitions of the display screen can transmit different binary coded information, the entire display screen can transmit more data, for example, information such as a pairing code and a device name can be transmitted.

[0171] Understandably, Figure 5 In the example, the display screen of the device is divided into 4 different display partitions, but the specific number M of the display partitions is not limited in the embodiment of the present application. When M is other values, the technical solution can be referred to. Figure 5 Related description in .

[0172] In other examples, the sum of the areas of display partition 1, display partition 2, display partition 3, and display partition 4 may be 1 / N of the area of ​​the display screen, where N is a positive integer greater than 1. In this case, the embodiments of the present application do not limit the specific position distribution of the above-mentioned multiple display partitions in the display screen. For example, the multiple display partitions may be located in the middle of the display screen, or the multiple display partitions may be located in a corner of the display screen, etc.

[0173] It should be understood that the above-mentioned display screen is described by taking the example of vertically dividing the display screen into display partition 1, display partition 2, display partition 3 and display partition 4. In other examples, the display screen can also be divided into display partition 1, display partition 2, display partition 3 and display partition 4 in a horizontal or oblique manner.

[0174] In other examples, device A may also divide the display screen into multiple display partitions in other equal division methods. Figure 6 It is a schematic diagram of another display screen provided by an embodiment of the present application, in which different display partitions transmit different binary coded information to the outside.

[0175] See also Figure 6 , device A can also divide the display screen into four display partitions according to the corner division method. Among them, display partition 1 is located at the upper left corner of the display screen, display partition 2 is located at the upper right corner of the display screen, display partition 3 is located at the lower left corner of the display screen, and display partition 4 is located at the lower right corner of the display screen, and each display partition can transmit a binary coded information.

[0176] Assuming that the device connection information is a pairing code, the device can first convert the pairing code into corresponding binary coded information. The way in which device A controls the bright display or dark display of each display partition according to the binary coded information, and the way in which each display partition transmits different binary coded information to the outside can be referred to the relevant description in the previous text, and for the sake of brevity, it will not be repeated here.

[0177] In this case, the device B may include a processing module capable of performing the above-mentioned signal processing, and the processing module may perform signal processing on the images of each display partition of the display screen in a certain order to identify the corresponding binary coded information. For example, the processing module identifies the corresponding binary coded information in the order of display partition 1, display partition 2, display partition 3, and display partition 4.

[0178] In mode three, device A can control the bright display or dark display of the image displayed on the display screen to achieve the transmission of binary coded information. Figure 7 It is a schematic diagram provided by an embodiment of the present application for transmitting different binary coded information externally through bright display or dark display of an image.

[0179] See also Figure 7 Device A can adjust the brightness of the displayed image according to the binary coded information, and realize the transmission of the binary coded information by bright or dark display of the image.

[0180] For binary coded information "0", device A can reduce the brightness of the image based on the original displayed image; for binary coded information "1", device A can increase the brightness of the image based on the original displayed image to achieve light and dark changes.

[0181] Still taking the device connection information as the pairing code, and the pairing code as "656579" as an example for explanation. For the number 6, its corresponding binary code information is "0110". For the T-th frame image that starts to transmit the binary code information "0", device A can reduce the brightness value of the pixels of the T-th frame image, and the reduced brightness value is less than the threshold. In this case, the human eye can not distinguish the change in the brightness value. For the T+1-th frame and the T+2-th frame image that transmit the binary code information "1", device A can increase the brightness value of the pixels of the T+1-th frame and the T+2-th frame image, and the increased brightness value is the same as the brightness value reduced in the T-th frame. Similarly, for the T+3-th frame image that transmits the binary code information "0", device A can reduce the brightness value of the pixels of the T-th frame image. Afterwards, device A can continue to transmit other numbers in the above manner.

[0182] It should be understood that before the Tth frame image, multiple consecutive frames of marked frames with the same brightness may also be included. For details, please refer to the relevant description in the above text, and for the sake of brevity, it will not be repeated here.

[0183] It should be understood that the manner in which device B obtains binary coded information by acquiring multiple frames of images displayed by device A can refer to the relevant description in the foregoing text.

[0184] In other examples, when device A increases or decreases the brightness of an image according to binary coded information, it may increase or decrease the brightness of the entire image, or may increase or decrease the brightness of part of the image, which is not limited in the embodiments of the present application.

[0185] In other examples, several original images may be included between the Tth frame image and the T+1th frame image, the T+1th frame image and the T+2th frame image, and the T+2th frame image and the T+3th frame image, which is not limited in the embodiments of the present application. In this case, device A does not need to process each frame image, thereby reducing the encoding overhead of device A and reducing the power consumption of device A.

[0186] Figure 8 is a schematic interactive diagram of a method for connecting devices provided in an embodiment of the present application. Figure 8 As shown, the method 800 is applied to a first device and a second device, and the method 800 may include steps 810 to 860.

[0187] 810. When the second device detects that the trigger condition is met, the second device converts the device connection information of the second device into binary coded information, where the device connection information is used to establish a connection relationship between the second device and the first device.

[0188] Exemplarily, the trigger condition may include at least one of the following conditions: the second device is a vehicle, and one side door of the vehicle is closed (such as the passenger seat); there is someone sitting in the passenger seat; the distance between the second device and the first device is less than or equal to a preset distance, etc.

[0189] The device connection information may include at least one of a connection pairing code of the second device, a product serial number of the second device, or a media access control MAC address of the second device.

[0190] For example, if the device connection information is the connection pairing code "656579", the binary code information converted from the device connection information is "01100101 0110 0101 0111 1001".

[0191] 820. The second device controls the display screen of the second device to change brightness according to the binary coded information.

[0192] The second device can control the display screen to change brightness according to the binary coded information. For example, for the binary coded information "1", the display screen can be bright, and for the binary coded information "0", the display screen can be dark. Alternatively, for the binary coded information "1", the display screen can display normally, and for the binary coded information "0", the display screen can not display or turn off.

[0193] In this way, the second device can control the brightness of the display screen to transmit binary coded information.

[0194] In other examples, the second device may also convert the device connection information into binary coded information without detecting whether the trigger condition is met, and control the display screen to change brightness according to the binary coded information.

[0195] It can be understood that the light and dark changes in the implementation of this application can also be called light and dark changes, brightness changes, etc.

[0196] 830. The first device detects a first operation and obtains a plurality of frames of images displayed by the second device through a camera.

[0197] Optionally, the first device and the second device may be in the same local area network, or the first device and the second device may log in to the same account (such as a Huawei account).

[0198] The first operation may be an operation that triggers the first device to connect to the device. For example, the first operation may be an operation of clicking a scan sub-function or a slow motion sub-function in a camera application; or, the first operation may be an operation of a user sliding from a fixed area of ​​a display screen of the first device, for example, the first operation is an operation of a user sliding from a corner of the display screen along a certain angle; or, the control center of the drop-down menu bar of the first device has a shortcut function button, and the first operation may be an operation of a user clicking the function button; or, the lock screen interface of the first device includes a shortcut button, and the first operation may be an operation of a user clicking the shortcut button. The embodiments of the present application do not limit the specific form of the first operation.

[0199] 840. The first device determines binary coded information through multiple frames of images, where the binary coded information includes device connection information of the second device.

[0200] In some examples, the first device may perform signal processing on the entirety of the multiple frames of images to determine brightness change information in the multiple frames of images, and determine binary coding information based on the brightness change information.

[0201] In other examples, the first device may also perform signal processing on a partial area of ​​the multi-frame image to determine brightness change information of the partial area in the multi-frame image, and determine binary coded information based on the brightness change information. In this way, the first device can connect the devices without acquiring the image of the entire display screen of the second device, thereby improving the convenience of device connection.

[0202] In other examples, the first device may also obtain multiple frame images of multiple display partitions of the display screen of the second device, and perform signal processing on the multiple frame images of the multiple display partitions in a preset order, obtain brightness and darkness change information in the multiple frame images of the multiple display partitions, and determine binary coding information based on the brightness and darkness change information.

[0203] 850. The first device determines device connection information of the second device according to the binary coded information.

[0204] After determining the binary coded information, the first device may decode the binary coded information to obtain corresponding device connection information.

[0205] 860. The first device establishes a connection relationship with the second device according to the device connection information.

[0206] The first device can determine the second device according to the acquired device connection information, and further establish a connection relationship with the second device. It should be understood that the technical solution for establishing a connection relationship between the first device and the second device can refer to the relevant description in the above text, which will not be repeated here.

[0207] In one embodiment of the present application, the second device can convert device connection information into binary coded information, and control the brightness of the display screen according to the binary coded information; when the first device detects the first operation, it can obtain multiple frames of images of the display screen of the second device through a camera, determine the binary coded information transmitted by the multiple frames of images, and determine the device connection information in the binary coded information, and further establish a connection relationship with the second device based on the device connection information of the second device.

[0208] In this way, when connecting devices, the user only needs to perform the operation to trigger the establishment of the device connection, scan the image on the display screen of the second device through the camera of the first device, and obtain the device connection information indicated by the image, thereby completing the connection between the first device and the second device. This can shorten the interaction path of the device connection, simplify the device connection process, and make device connection more convenient.

[0209] In some embodiments, the first device determines binary coded information through multiple frames of images, including:

[0210] The first device performs signal processing on the multiple frames of images to obtain first brightness change information in the multiple frames of images;

[0211] The first device determines binary coded information according to the first brightness change information.

[0212] Exemplarily, the signal processing method may be envelope analysis, curve fitting, or the like.

[0213] The brightness change corresponding to the first brightness change information can be achieved by the second device adjusting the brightness of the light source, or the brightness change corresponding to the first brightness change information can be achieved by the second device controlling the light source to turn on or off, or the brightness change corresponding to the first brightness change information can also be achieved by the second device adjusting the brightness value of the pixels of the displayed image.

[0214] Based on the embodiment of the present application, the first device can perform signal processing on the acquired multiple frames of images to determine the first brightness change information in the image, and determine the binary coding information based on the first brightness change information, so as to determine the device connection information of the second device.

[0215] In some embodiments, the first device performs signal processing on multiple frames of images to obtain first brightness change information in the multiple frames of images, including:

[0216] The first device identifies a partial area with brightness changes in the multiple frames of images;

[0217] The first device performs signal processing on a partial area in the multiple frames of images to obtain first brightness change information of the partial area.

[0218] For example, the partial area may be an area at a preset position of the multiple-frame image, or the portion may be an area with a preset area or shape at a middle position of the multiple-frame image.

[0219] Based on the embodiment of the present application, the second device can control part of the light sources of the display screen to change brightness according to the binary coded information, so that the first device can perform signal processing on the partial area with brightness changes of the acquired multi-frame images to obtain the corresponding first brightness change information, thereby reducing the amount of data for signal processing while also identifying the corresponding binary coded information.

[0220] Optionally, the partial area may be any area with a preset area in the multi-frame image. For example, the entire image in the multi-frame image undergoes synchronous brightness changes, so that the second device only needs to obtain a partial area of ​​the multi-frame image and can also obtain brightness change information to determine the corresponding binary coded information. This can improve the use scenarios of device connection.

[0221] In some embodiments, the first device obtains multiple frames of images displayed by the second device through a camera, including:

[0222] The first device acquires multiple frames of images of multiple display partitions of the display screen of the second device through a camera;

[0223] The first device determines binary coded information through multiple frames of images, including:

[0224] The first device performs signal processing on the multiple frames of images of the multiple display partitions in a preset order to obtain second brightness change information in the multiple frames of images of the multiple display partitions;

[0225] The first device determines binary coded information according to the second brightness change information.

[0226] For example, see Figure 5 , Figure 6 , the display screen of the second device can be divided into a plurality of display partitions. The preset order can be the order of display partition 1 to display partition 4, such as Figure 5 As shown, display partitions 1 to 4 can transmit binary coded information "0110" at one time. Alternatively, the preset order can also be that each display partition displays multiple binary coded information, and then the first device can splice the binary coded information to obtain the final binary coded information.

[0227] Based on the embodiment of the present application, the second device can also divide the display screen into multiple display partitions, and can control the multiple display partitions to change brightness according to the binary coded information in a preset order. In this case, the first device can obtain multiple frames of images of the above multiple display partitions, and perform signal processing on the multiple frames of images of the multiple display partitions in a preset order, obtain the second brightness change information in the multiple frames of images of the multiple display partitions, and further determine the corresponding binary coded information.

[0228] In this case, the binary coded information that can be transmitted by the multiple display partitions has a larger data volume, so that the first device can obtain more data from the multiple frames of images of the multiple display partitions.

[0229] In some embodiments, the first device obtains multiple frames of images displayed by the second device through a camera, including:

[0230] The first device acquires a plurality of frames of images through a slow motion mode of a camera.

[0231] In other examples, the first device may also acquire the above-mentioned multiple frames of images through the normal mode of the camera, which is not limited in the embodiments of the present application.

[0232] In some embodiments, the device connection information includes at least one of a connection pairing code of the second device, a product serial number of the second device, and a media access control MAC address of the second device.

[0233] In other examples, the device connection information may also include other information, such as mapping information of the product serial number of the second device, configuration information of the second device, etc.

[0234] In some embodiments, the second device controls the display screen of the second device to change brightness according to the binary coded information, including:

[0235] The second device controls the light source of the backlight layer of the display screen to increase or decrease the brightness according to the binary coded information.

[0236] For example, for binary coded information "1", the second device can increase the current or voltage of the light source of the backlight layer so that the light source increases its brightness; or, for binary coded information "0", the second device can reduce the current or voltage of the light source of the backlight layer so that the light source decreases its brightness.

[0237] This technical solution can enable the second device to control the brightness of the display screen according to the binary coded information to transmit the binary coded information to the outside.

[0238] In some embodiments, controlling the display screen of the second device to change brightness according to the binary coded information includes:

[0239] The second controls the light source of the backlight layer of the display screen to light up or turn off according to the binary coded information.

[0240] In the embodiment of the present application, turning on or off the light source is a way of changing the brightness of the display screen. For example, for binary coded information "1", the second device can control the light source of the backlight layer to turn on; for binary coded information "0", the second device can control the light source of the backlight layer to turn off, so that the second device can transmit binary coded information by turning on or off the light source.

[0241] This technical solution can enable the second device to control the brightness of the display screen according to the binary coded information to transmit the binary coded information to the outside.

[0242] In some embodiments, controlling the display screen of the second device to change brightness according to the binary coded information includes:

[0243] The second device increases or decreases the brightness value of the pixels of the image displayed on the display screen according to the binary coded information.

[0244] For example, for binary coded information "1", the second device can increase the brightness value of the pixels of the displayed image to make the displayed image brighter; for binary coded information "0", the second device can reduce the brightness value of the pixels of the displayed image to make the displayed image brighter.

[0245] This technical solution can enable the second device to control the brightness of the display screen according to the binary coded information to transmit the binary coded information to the outside.

[0246] In some embodiments, the display screen of the second device includes a plurality of display partitions, wherein controlling the display screen of the second device to change brightness according to the binary coded information includes:

[0247] The second device controls the plurality of display partitions to change brightness according to the binary coded information in a preset order.

[0248] For example, see Figure 5 or Figure 6 The display screen of the second device may be divided into a plurality of display partitions. The preset order may be the order of display partitions 1 to 4, such as Figure 5 As shown, the second device can control display partitions 1 to 4 to transmit binary coded information "0110" at a time. Alternatively, the preset order can also be that the second device controls each display partition to display multiple binary coded information, and then the first device can splice the binary coded information to obtain the final binary coded information.

[0249] Based on the embodiment of the present application, the display screen of the second device can be divided into multiple display partitions, and the second device can control the multiple display partitions to change brightness according to the binary coded information in a preset order. In this way, the second device can transmit more data to the outside.

[0250] In some embodiments, controlling the display screen of the second device to change brightness according to the binary coded information includes:

[0251] The second device controls a partial area of ​​the display screen of the second device to change brightness according to the binary coded information.

[0252] Exemplarily, the partial area may be an area at a preset position of the display screen, or the portion may be an area with a preset area or shape at a middle position of the display screen.

[0253] Based on the embodiment of the present application, the second device can also control the brightness of a partial area of ​​the display screen according to binary coded information without encoding the entire area of ​​the display screen, thereby reducing the coding overhead of the second device and reducing the power consumption of the second device.

[0254] Fig. 9 is a schematic block diagram of a device provided in an embodiment of the present application. Fig. 9 As shown, the device 900 may include one or more processors 910; one or more memories 920; the one or more memories 920 store one or more programs, and when the one or more programs are executed by one or more processors 910, the method for connecting the devices as described in any possible implementation method described above is executed.

[0255] In some embodiments, the device 900 may be the first device mentioned above, for example, a smart phone, a tablet computer, etc.

[0256] In other embodiments, the device 900 may be the second device mentioned above, for example, a tablet computer, a smart TV, a vehicle-mounted device, a smart home device, etc.

[0257] An embodiment of the present application also provides a system, including the first device and the second device in the above embodiment.

[0258] An embodiment of the present application also provides a chip, which includes a processor and a communication interface, wherein the communication interface is used to receive a signal and transmit the signal to the processor, and the processor processes the signal so that the device connection method described in any possible implementation method in the foregoing text is executed.

[0259] It is understandable that, in order to implement the above functions, the device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and software. Whether a function is executed in the form of hardware or software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of this application.

[0260] In this embodiment, the functional modules of the device can be divided according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated modules can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0261] This embodiment also provides a device connection apparatus, including a module for implementing the device connection method in the above embodiment.

[0262] This embodiment further provides a readable storage medium, in which instructions are stored. When the instructions are executed on a device, the device executes the above-mentioned related method steps to implement the device connection method in the above-mentioned embodiment.

[0263] This embodiment also provides a program product. When the program product is run on a device, the device executes the above-mentioned related steps to implement the device connection method in the above-mentioned embodiment.

[0264] In addition, an embodiment of the present application also provides a device, which may specifically be a chip, a component or a module, and the device may include a connected processor and a memory; wherein the memory is used to store execution instructions, and when the device is running, the processor may execute the execution instructions stored in the memory so that the chip executes the device connection method in the above-mentioned method embodiments.

[0265] Among them, the device, equipment, readable storage medium, program product or chip provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0266] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0267] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0268] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0269] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0270] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0271] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks or optical disks.

[0272] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for connecting a device, characterized in that: The method is applied to a first device, and the method includes: Upon detecting the first operation, a plurality of frames of images displayed by the second device are acquired through a camera; Determining binary coded information through the multiple frames of images, wherein the binary coded information includes device connection information of the second device; determining device connection information of the second device according to the binary coded information; A connection relationship is established with the second device according to the device connection information.

2. The method according to claim 1, characterized in that The determining the binary coded information through the multiple frames of images includes: Performing signal processing on the multiple frames of images to obtain first brightness change information in the multiple frames of images; The binary coded information is determined according to the first brightness change information.

3. The method according to claim 2, characterized in that Performing signal processing on the multiple frames of images to obtain first brightness change information in the multiple frames of images includes: Identifying partial regions with light and dark changes in the multiple frames of images; Signal processing is performed on the partial area in the multiple frames of images to obtain first brightness change information of the partial area.

4. The method according to claim 1 or 2, characterized in that: The step of acquiring multiple frames of images displayed by the second device through a camera includes: Acquire, by the camera, a plurality of frames of images of a plurality of display partitions of a display screen of the second device; Wherein, determining the binary coded information through the multiple frames of images includes: Performing signal processing on the multiple frames of images of the multiple display partitions in a preset order to obtain second brightness change information in the multiple frames of images of the multiple display partitions; The binary coded information is determined according to the second brightness change information.

5. The method according to any one of claims 1 to 4, characterized in that The step of acquiring multiple frames of images displayed by the second device through a camera includes: The multiple frames of images are acquired through a slow motion mode of a camera.

6. The method according to any one of claims 1 to 5, characterized in that The device connection information includes at least one of a connection pairing code of the second device, a product serial number of the second device, and a media access control MAC address of the second device.

7. A method for connecting a device, characterized in that: The method is applied to a second device, and the method includes: When it is detected that the trigger condition is met, converting the device connection information of the second device into binary coded information, wherein the device connection information is used for the second device to establish a connection relationship with the first device; The display screen of the second device is controlled to change brightness according to the binary coded information.

8. The method according to claim 7, characterized in that The controlling the display screen of the second device to change brightness according to the binary coded information includes: The light source of the backlight layer of the display screen is controlled to increase or decrease the brightness according to the binary coded information.

9. The method according to claim 7, characterized in that: The controlling the display screen of the second device to change brightness according to the binary coded information includes: The light source of the backlight layer of the display screen is controlled to light up or turn off according to the binary coded information.

10. The method according to claim 7, characterized in that The controlling the display screen of the second device to change brightness according to the binary coded information includes: The brightness value of the pixel of the image displayed on the display screen is increased or decreased according to the binary coded information.

11. The method according to any one of claims 7 to 10, characterized in that: The display screen includes a plurality of display partitions, wherein controlling the display screen of the second device to change brightness according to the binary coded information includes: The plurality of display partitions are controlled to change brightness according to the binary coded information in a preset order.

12. The method according to any one of claims 7 to 10, characterized in that: Controlling the display screen of the second device to change brightness according to the binary coded information includes: Control a partial area of ​​the display screen of the second device to change brightness according to the binary coded information.

13. The method according to any one of claims 7 to 12, characterized in that: The device connection information includes at least one of a connection pairing code of the second device, a product serial number of the second device, and a media access control MAC address of the second device.

14. A device, characterized in that include: one or more processors; One or more memories; the one or more memories store one or more programs, and when the one or more programs are executed by the one or more processors, the method for connecting a device as described in any one of claims 1 to 6 is executed, or the method for connecting a device as described in any one of claims 7 to 13 is executed.

15. A chip, characterized in that: The chip includes a processor and a communication interface, wherein the communication interface is used to receive a signal and transmit the signal to the processor, and the processor processes the signal so that the device connection method described in any one of claims 1 to 6 is executed, or the device connection method described in any one of claims 7 to 13 is executed.

16. A readable storage medium, characterized in that: The readable storage medium stores instructions, and when the instructions are executed on the device, the device connection method according to any one of claims 1 to 6 is executed, or the device connection method according to any one of claims 7 to 13 is executed.

Citation Information

Patent Citations

  • Method, device and terminal for outputting information through display screen

    CN102779503A

  • First electronic apparatus and method of actively pairing the same with second electronic apparatus for wireless communication

    CN105517185A

  • Optical label coding and identification method

    CN106372701A

  • Information processing method and related equipment

    CN116170544A

Cited By

  • Device connection method and device

    EP4733949A1

  • Device connection method and device

    WO2025036094A1