Short-distance communication method, electronic equipment and communication system

Abstract

A short-distance communication method, an electronic device and a communication system relate to the technical field of communication. The method is applied to a first device configured with a screen, and the first device can obtain a digital sequence capable of indicating N signals based on to-be-sent information and display N frames of first images on the screen. Wherein the N frames of first images correspond to the N frames of second images respectively, the N frames of second images are images displayed on a screen of the first equipment under the condition that the screen communication function is not started, and visual perception results of the user on the N frames of first images and the N frames of second images are the same. The change rule of the color information of the N frames of first images is related to the change rule of the N signals. According to the method, a user of the first equipment does not perceive the operation, the second equipment with a camera shooting function scans the N frames of first images and demodulates to obtain the to-be-sent information of the first equipment, the operation is simple, the directivity is good, and the user experience can be improved.

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to a short-distance communication method, an electronic device and a communication system. Background Art

[0002] With the development of communication technology, short-range communication technology, such as Bluetooth (BT) technology or wireless fidelity (WiFi) technology, is widely used in daily life. Usually, before short-range communication between devices, a connection needs to be established, such as requiring users to search for the corresponding device and enter a password, which is complicated and has a poor user experience. Summary of the invention

[0003] The present application provides a short-distance communication method, an electronic device, and a communication system, which can solve the problem of complex user operations in short-distance communication and improve user experience.

[0004] In order to achieve the above purpose, the present application adopts the following technical solutions:

[0005] In a first aspect, a short-distance communication method is provided, which can be performed by a first device equipped with a screen. The first device here can refer to the first device itself, or a processor, module, logical node, chip, or chip system that implements the method in the first device.

[0006] The method includes: obtaining a first digital sequence for indicating N signals based on information to be sent; and continuously displaying N frames of first images on the screen of the first device. The N frames of first images correspond to N consecutive frames of second images respectively, and the N frames of second images are images displayed on the screen of the first device when the screen communication function of the first device is not turned on. The visual perception result of the user on the N frames of first images is the same as the visual perception result of the user on the N frames of second images; the change rule of the color information of the N frames of first images is related to the change rule of the N signals, and the color information of the i-th frame of the first image indicates the color accumulation value of the pixel points in the i-th frame of the first image, N is an integer greater than 1, and i is an integer greater than 1 and less than or equal to N.

[0007] Based on the method provided in the first aspect above, the first device can modulate the information to be sent onto the N frames of the first image displayed by the first device. In this way, a device with a video or camera function, such as the second device, can scan the N frames of the first image and demodulate and restore the information to be sent, thereby realizing "communication" between devices. In the above-mentioned "communication" process, the device to be "communicated" can be selected by adjusting the orientation of the device 102. The user does not need to manually search for the device. The operation is simple and has good directionality, which can improve the user experience. In addition, since the user's visual perception results of the N frames of the first image are the same as the user's visual perception results of the N frames of the second image, the information to be sent integrated in the first image is "transparent" to the user, and the user cannot perceive it, which does not affect the user's use of the first device.

[0008] In a possible implementation, the user's visual perception result of N frames of the first image is the same as the user's visual perception result of N frames of the second image, including: the screen refresh rate of the first device is greater than or equal to the first threshold; the absolute value of the difference between the brightness of the first pixel in the i-th frame of the first image and the brightness of the first pixel in the i-th frame of the second image is less than or equal to the second threshold, and the first pixel is any pixel on the screen of the first device; the absolute value of the difference between the first color information and the second color information is less than or equal to a third threshold, the first color information is the color information of the first pixel in M ​​consecutive frames of the first image in N frames, and the second color information is the color information of the first pixel in M ​​frames of the second image corresponding to the M frames of the first image, and M is an integer greater than 1 and less than or equal to N.

[0009] It is understandable that when two different colors flicker alternately, but the brightness does not change much, and the flickering frequency is greater than a certain value, the human eye sees the fused color and cannot perceive the color flicker. Therefore, based on the above possible implementation, the user cannot distinguish the difference between the first image and the second image, that is, the information of the N signals fused in the N frames of the first image is "transparent" to the user and does not affect the content originally displayed on the screen.

[0010] In a possible implementation manner, obtaining a first digital sequence based on information to be sent includes: modulating the information to be sent at a first bandwidth and a first frequency to obtain the first digital sequence.

[0011] Based on the above possible implementations, the information to be sent can be modulated to obtain a first digital sequence. For example, the information to be sent can be digitally baseband modulated to obtain a first bit sequence, and the first bit sequence can be phase modulated at a first bandwidth and a first frequency to obtain a first digital sequence.

[0012] In a possible implementation, the changing law of color information of N frames of first images is related to the changing law of N signals, including: within the first bandwidth, the changing law of color information of N frames of first images is related to the changing law of N signals in the frequency domain, or the changing law of color information of N frames of first images is related to the changing law of N signals in the time domain.

[0013] Based on the possible implementation methods described above, the information of the N signals may be integrated into the color information of the N frames of first images, so that a device with a camera function can scan the first images and demodulate according to changes in the color information to restore the information to be sent.

[0014] In a possible implementation, the first frequency is less than or equal to half of a screen refresh rate of the first device.

[0015] It is understandable that when performing phase modulation, the modulation frequency is usually not greater than half of the current refresh rate of the screen. Therefore, the first frequency is less than or equal to half of the screen refresh rate of the first device. In addition, the higher the modulation frequency, the more "transparent" the information of the N signals fused in the N-frame first image is to the user. Therefore, if the first frequency is equal to half of the screen refresh rate of the first device, the user's perception of the N signals fused in the N-frame first image can be minimized. If the first frequency is less than the screen refresh rate of the first device, the computing power of the first device can be saved and power consumption can be reduced.

[0016] In a possible implementation, the method also includes: continuously displaying R frames of first images on the screen of the first device, the R frames of first images respectively corresponding to continuous R frames of second images, the R frames of second images being images displayed on the screen of the first device when the screen communication function of the first device is not turned on, the user's visual perception result of the R frames of first images is the same as the user's visual perception result of the R frames of second images, the change pattern of color information of the R frames of first images is related to the change pattern of the R signals, the R signals are signals indicated by synchronization sequences, R is an integer greater than 1, the color information of the j-th frame of the first image indicates the color accumulation value of the pixel points in the j-th frame of the first image, j is an integer greater than 1 and less than or equal to R, and the time period during which the R frames of first images are displayed on the screen of the first device is different from the time period during which the N frames of first images are displayed on the screen of the first device.

[0017] Based on the above possible implementation methods, the first device can modulate the synchronization sequence onto the R frame first image displayed by the first device, so that the device with a camera function can determine the N frame first image in the scanned image based on the R frame first image.

[0018] In a possible implementation manner, the method further includes: acquiring a synchronization sequence, where the synchronization sequence is modulated on a second frequency, and the second frequency is different from the first frequency.

[0019] Based on the possible implementation manners described above, the device with a camera function may determine R-frame first images according to the second frequency, and then determine N-frame first images in the scanned image according to the R-frame first images.

[0020] In a possible implementation, the method further includes: continuously displaying N frames of first images on a screen of the first device, including: fusing the N signals with the N frames of second images respectively, and continuously displaying the N frames of first images on the screen of the first device.

[0021] Based on the above possible implementation manner, the first device may fuse the N signals with the N frames of the second image respectively, so as to modulate the information to be sent onto the N frames of the first image.

[0022] In one possible implementation, each frame of the first image includes P areas, and the positions and sizes of the P areas included in any two frames of the first image are the same. The first digital sequence also indicates (P-1)*N signals. The first digital sequence includes P segment sequences, each segment sequence indicates N continuous signals among the P*N signals, and the P areas correspond to the P segment sequences respectively. The change law of the N frames of color information in each area is related to the change law of the N continuous signals corresponding to the area, and P is an integer greater than 1.

[0023] Based on the above possible implementation methods, the first image can be divided into regions, and N frames of color information in each region can be fused with different signals, so that a device with a camera function can scan a frame of the first image and demodulate multiple signals, thereby shortening the time it takes for the device to scan the first image.

[0024] In a possible implementation manner, a change rule of brightness information of N frames of first images is related to a change rule of N signals.

[0025] Based on the above possible implementation manner, the first device may also fuse the information of the N signals into the brightness information of the N frames of the first image.

[0026] In a possible implementation manner, the brightness information of the i-th frame of the first image indicates the brightness accumulation value of the pixel points in the i-th frame of the first image.

[0027] Based on the possible implementation manner described above, the brightness information of the i-th frame of the first image may be determined.

[0028] In a possible implementation, the changing law of the brightness information of the N frames of the first image is related to the changing law of the N signals, including: within a first bandwidth, the changing law of the brightness information of the N frames of the first image is related to the changing law of the N signals in the frequency domain, or the changing law of the brightness information of the N frames of the first image is related to the changing law of the N signals in the frequency domain; the first bandwidth is the modulation bandwidth of the first digital sequence.

[0029] Based on the possible implementation manner described above, a device with a camera function can scan N frames of first images and demodulate them according to changes in brightness information to restore information to be sent.

[0030] In one possible implementation, each frame of the first image includes P areas, and the positions and sizes of the P areas included in any two frames of the first image are the same. The first digital sequence also indicates (P-1)*N signals. The first digital sequence includes P segment sequences, each segment sequence indicates N continuous signals among the P*N signals, and the P areas correspond to the P segment sequences respectively. The change law of the N frames of brightness information in each area is related to the change law of the N continuous signals corresponding to the area, and P is an integer greater than 1.

[0031] Based on the above possible implementation methods, the first image can be divided into areas, and N frames of brightness information in each area can be fused with different signals, so that a device with a camera function can scan a frame of the first image and demodulate multiple signals, thereby shortening the time it takes for the device to scan the first image.

[0032] In a possible implementation, the method also includes: accessing a first network; obtaining a first shooting frame rate, where the first shooting frame rate is the lowest shooting frame rate supported by a device with a camera function in the first network; and setting a screen refresh rate of the first device according to the first shooting frame rate.

[0033] Based on the above possible implementation methods, the first device can set the refresh rate according to the lowest shooting frame rate supported by the device with a camera function in the first network, so that when the device with a camera function in the first network scans N frames of the first image, the shooting frame rate used is greater than or equal to the screen refresh rate of the first device, thereby realizing the scanning of N frames of the first image.

[0034] In a possible implementation manner, the method further includes: receiving first indication information, where the first indication information indicates to enable the screen communication function.

[0035] Based on the possible implementation manners described above, the first device may enable the screen communication function according to the instructions.

[0036] In a second aspect, a short-distance communication method is provided, which can be performed by a second device with a camera function. The second device here can refer to the second device itself, or a processor, module, logical node, chip, or chip system that implements the method in the second device. In this application, the camera function can be replaced by the photo function.

[0037] The method comprises: scanning N frames of first images displayed on the screen of the first device through a camera function, and performing demodulation to obtain information to be received, where N is an integer greater than 1.

[0038] Based on the method provided in the second aspect above, the second device can realize "communication" between the first device and the second device by scanning N frames of the first image displayed on the screen of the first device and demodulating the information that the first device wants to "send" to the second device.

[0039] In a possible implementation, the method also includes: accessing a first network; obtaining a first shooting frame rate, where the first shooting frame rate is the lowest shooting frame rate supported by a device with a camera function in the first network; and setting a shooting frame rate of the camera function according to the first shooting frame rate.

[0040] Based on the above possible implementation methods, the second device can set the shooting frame rate of the camera function according to the lowest shooting frame rate supported by the device with the camera function in the first network to realize scanning of N frames of the first image.

[0041] In a possible implementation manner, the method further includes: sending first indication information, where the first indication information indicates to enable the screen communication function.

[0042] Based on the possible implementation manner described above, the device with a screen (such as the first device) may be instructed to enable the screen communication function.

[0043] In a possible implementation manner, the method further includes: sending second indication information, where the second indication information indicates a shooting frame rate supported by the second device.

[0044] Based on the above possible implementation manner, the shooting frame rate supported by itself can be sent so that the device receiving the second indication information, such as the host in the first network, can determine the first shooting frame rate.

[0045] In a third aspect, an electronic device is provided for implementing the method provided in the first aspect. The electronic device may be the first device in the first aspect. The electronic device includes a module, unit, or means corresponding to the method, which may be implemented by hardware, software, or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above functions.

[0046] In conjunction with the third aspect, in a possible implementation, the electronic device may include a processing module and a display module. The processing module may be used to implement the processing function in the first aspect and any possible implementation thereof. The processing module may be, for example, a processor. The display module may also be referred to as an interface unit, and is used to implement the display function in the first aspect and any possible implementation thereof. The display module may be, for example, a display screen.

[0047] In conjunction with the third aspect, in a possible implementation, the electronic device further includes an interface module. The interface module, which may also be referred to as an interface unit, is used to implement the sending and / or receiving functions in the first aspect and any possible implementation thereof. The interface module may be composed of an interface circuit, a transceiver, a transceiver or a communication interface.

[0048] In combination with the third aspect, in a possible implementation, the interface module includes a sending module and a receiving module, which are respectively used to implement the sending and receiving functions in the first aspect and any possible implementation thereof.

[0049] In a fourth aspect, an electronic device is provided for implementing the method provided in the second aspect. The electronic device may be the second device in the second aspect. The electronic device includes a module, unit, or means corresponding to the method, which may be implemented by hardware, software, or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above functions.

[0050] In conjunction with the fourth aspect, in a possible implementation, the electronic device may include a processing module. The processing module may be used to implement the processing functions in the second aspect and any possible implementation thereof. The processing module may be, for example, a processor.

[0051] In conjunction with the fourth aspect, in a possible implementation, the electronic device may further include an interface module. The interface module, which may also be referred to as an interface unit, is used to implement the sending and / or receiving functions in the second aspect and any possible implementation thereof. The interface module may be composed of an interface circuit, a transceiver, a transceiver or a communication interface.

[0052] In combination with the fourth aspect, in a possible implementation, the interface module includes a sending module and a receiving module, which are respectively used to implement the sending and receiving functions in the second aspect and any possible implementation thereof.

[0053] In a fifth aspect, an electronic device is provided, comprising: a processor; the processor is coupled to a memory, and after reading an instruction in the memory, executes the method as described in any of the above aspects according to the instruction. The electronic device may be the first device in the above first aspect; or the electronic device may be the second device in the above second aspect.

[0054] In conjunction with the fifth aspect, in a possible implementation, the electronic device further includes a memory, the memory being used to store program instructions and data. Optionally, the memory is integrated with the processor; or, the memory is independent of the processor.

[0055] In conjunction with the fifth aspect, in a possible implementation, the electronic device is a chip or a chip system. Optionally, when the electronic device is a chip system, it can be composed of a chip, or it can include a chip and other discrete devices.

[0056] In a sixth aspect, an electronic device is provided, comprising: a processor and an interface circuit; the interface circuit is used to receive a computer program or instruction and transmit it to the processor; the processor is used to execute the computer program or instruction so that the electronic device executes the method as described in any of the above aspects. The electronic device may be the first device in the above first aspect; or, the electronic device may be the second device in the above second aspect.

[0057] In conjunction with the sixth aspect, in a possible implementation, the electronic device is a chip or a chip system. Optionally, when the electronic device is a chip system, it can be composed of a chip, or it can include a chip and other discrete devices.

[0058] In a seventh aspect, a computer-readable storage medium is provided, wherein instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium is run on a computer, the computer can execute the method described in any one of the above aspects.

[0059] In an eighth aspect, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute the method described in any one of the above aspects.

[0060] In a ninth aspect, a communication system is provided, which includes a first device for executing the method described in the first aspect and a second device for executing the method described in the second aspect.

[0061] Among them, the technical effects brought about by any possible implementation method of the third to ninth aspects can refer to the technical effects brought about by any aspect of the first to second aspects or different possible implementation methods of any aspect, and will not be repeated here.

[0062] It can be understood that, under the premise that the solutions are not contradictory, the solutions in each aspect can be combined. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] Figure 1 A schematic diagram of the communication system architecture provided for this application;

[0064] Figure 2 A schematic diagram of the hardware structure of the electronic device provided for this application;

[0065] Figure 3 Schematic diagram of the short-distance communication method provided in this application Figure 1 ;

[0066] Figure 4A The first digital sequence provided by this application is shown in FIG. Figure 1 ;

[0067] Figure 4B A schematic diagram of the fusion of the signal provided by the present application and the second image;

[0068] Figure 5A The first digital sequence provided by this application is shown in FIG. Figure 2 ;

[0069] Figure 5B A schematic diagram of the change rules of the 120 frames of first images provided in this application in the time domain;

[0070] Figure 5C Schematic diagram of the frequency domain variation law of the R channel of the 120 frames of the first image provided in this application Figure 1 ;

[0071] Figure 5D A schematic diagram of color information and brightness information of 120 frames of second images provided in this application;

[0072] Figure 5E A schematic diagram of the change rule of the R channel of the 120 frames of the first image provided in this application in the time domain;

[0073] Fig. 5F Schematic diagram of the frequency domain variation law of the R channel of the 120 frames of the first image provided in this application Figure 2 ;

[0074] Figure 6 A schematic diagram of an area in a first image provided in this application;

[0075] Figure 7 A schematic diagram of a device provided in this application accessing a first network;

[0076] Figure 8 Schematic diagram of the short-distance communication method provided in this application Figure 2 ;

[0077] Fig. 9 The structure of the electronic device provided in this application is shown in FIG. Figure 1 ;

[0078] Fig.10 Structural diagram of the electronic device provided for this application Figure 2 . DETAILED DESCRIPTION

[0079] In order to solve the problem of complex user operations in short-distance communication, the present application provides a short-distance communication method, which can be applied to a first device and a second device. The first device is equipped with a screen, and the second device has a camera function. In this method, the first device can obtain a first digital sequence that can indicate N signals based on the information to be sent, and continuously display N frames of first images on the screen of the first device. The change law of the color information of the N frames of first images is related to the change law of the N signals, and the color information of the i-th frame of the first image in the N frames of first images indicates the color accumulation value of the pixel points in the i-th frame of the first image, i is an integer greater than 1 and less than or equal to N, and N is an integer greater than 1. The second device can scan the N frames of first images displayed on the screen of the first device through the camera function, and demodulate to obtain the information to be received. In the present application, the camera function is mainly used to scan the image displayed on the screen of the first device, so the camera function can be replaced by other functions that can realize the above functions, such as the camera function, etc., without limitation. For the convenience of description, the present application is introduced by taking the camera function as an example.

[0080] It can be understood that the N frames of the first image displayed on the first device incorporate the information of the N signals corresponding to the information to be sent. The second device scans the N frames of the first image through the camera function, and demodulates them to obtain the information to be sent by the first device (i.e., the information to be received by the second device). The above process does not require the participation of the user of the first device, and the user of the second device does not need to search for the first device. Instead, the direction of the second device is adjusted so that the camera module of the second device is quickly aligned with the screen of the first device, and the N frames of the first image displayed on the screen of the first device are scanned, so that "communication" between the first device and the second device can be achieved. Therefore, the above method is simple to operate and has good directionality, which can improve the user experience.

[0081] In some embodiments, N frames of first images correspond to N consecutive frames of second images respectively. Among them, the N frames of second images are images displayed on the screen of the first device when the screen communication function of the first device is not turned on, and the user's visual perception result of the N frames of first images is the same as the user's visual perception result of the N frames of second images. In other words, the i-th frame of the first image is the image obtained after the i-th signal is fused to the i-th frame of the second image, but the user cannot distinguish the difference between the first image and the second image, that is, the information of the N signals fused in the N frames of the first image is "transparent" to the user, and does not affect the content originally displayed on the screen. In this way, the user does not perceive the communication between the first device and the second device, and does not affect the user's use of the first device, which can further improve the user experience.

[0082] The method provided by this application can be used in communication systems for various screen devices and camera devices. Figure 1 Taking the communication system 10 as an example, the method provided in the present application is described. Figure 1 It is only a schematic diagram and does not constitute a limitation on the applicable scenarios of the technical solution provided in this application.

[0083] like Figure 1 , which is a schematic diagram of the architecture of the communication system 10 provided in the present application. Figure 1 In the invention, the communication system 10 may include a device 101 (corresponding to the first device in the invention content) and a device 102 (corresponding to the second device in the invention content). Optionally, the communication system 10 also includes a device 103 that can be communicatively connected with the device 101 and the device 102. Among them, the device 101 is configured with a screen to display an image that incorporates the information to be sent. The device 102 has a camera function, for example, the device 102 is configured with a camera to scan the image displayed on the screen of the device 101. The device 103 can assist the device 101 and the device 102 to achieve communication between the two. For example, the device 103 can assist the device 101 in setting the screen refresh rate, and assist the device 102 in setting the shooting frame rate, so that the shooting frame rate of the device 102 is greater than or equal to the screen refresh rate of the device 101, to ensure that the device 102 can capture the image displayed on the device 101.

[0084] exist Figure 1In the present application, the device 103 and the device 101 can communicate by wire or wirelessly, and the device 103 and the device 102 can communicate by wire or wirelessly. In the present application, the wireless communication includes but is not limited to Bluetooth communication, cellular communication, Star Flash standard communication or wireless fidelity (WiFi) communication. Among them, the cellular communication is, for example, the fourth generation (4G) communication, the fifth generation (5G) communication or the future evolved communication (such as: the sixth generation (6G) communication).

[0085] In some embodiments, device 101 and device 102 may be in the same network. For example, device 101 and device 102 are connected to the same WiFi network (such as a whole-house smart network), or connected to the same local area network (such as a network deployed in a smart park). For another example, device 101 and device 102 are both connected to device 103.

[0086] Optionally, device 101 or device 102 may also have the function of device 103.

[0087] Optionally, the device 101 may have a camera function.

[0088] Optionally, device 102 may be configured with a screen.

[0089] Optionally, an operating system, such as the Harmony system, is deployed on device 101 and device 102. The system may also be deployed on device 103. In some embodiments, the operating system may also be an Android system or other operating systems.

[0090] It is understandable that the present application does not limit the product form of devices 101 to 103, and devices 101, 102 or 103 may be handheld devices, vehicle-mounted devices, wearable devices or computing devices, etc. Exemplarily, device 101 may be a mobile phone, a tablet computer, a laptop computer, a PDA, a mobile internet device (MID), a satellite terminal, a desktop computer, a smart screen, an intelligent robot, a terminal in industrial control, a terminal in unmanned driving, a terminal in telemedicine, a terminal in smart grid, a terminal in transportation safety, a terminal in smart city, a terminal in smart home, a vehicle-mounted terminal or a smart watch, etc. Device 102 may be a mobile phone, a tablet computer, a laptop computer, a PDA, a MID, a satellite terminal, a camera device, an intelligent robot, a terminal in industrial control, a terminal in unmanned driving, a terminal in telemedicine, a terminal in smart grid, a terminal in transportation safety, a terminal in smart city, a terminal in smart home, a vehicle-mounted terminal or a smart watch, etc. Device 103 may be a whole-house smart host, a router, a central control screen, a mobile phone, a tablet computer, a laptop computer, a desktop computer, a switch, a modem or an intelligent robot, etc.

[0091] Figure 1 The communication system 10 shown is only used as an example and is not used to limit the technical solution of the present application. Those skilled in the art should understand that in the specific implementation process, the communication system 10 may also include other devices, for example, a device with a screen other than the device 101, and / or a camera device other than the device 102.

[0092] Optional, this application Figure 1 Each device in the embodiment (eg, device 101, device 102, or device 103) may also be referred to as an electronic device, which may be a general-purpose device or a dedicated device, and this application does not make any specific limitation on this.

[0093] Optional, this application Figure 1 The related functions of each device (e.g., device 101, device 102, or device 103) in the network can be implemented by one device, or by multiple devices together, or by one or more functional modules in one device, and this application does not make specific restrictions on this. It can be understood that the above functions can be network elements in hardware devices, software functions running on dedicated hardware, or a combination of hardware and software, or virtualization functions instantiated on a platform (e.g., a cloud platform).

[0094] In specific implementation, this application Figure 1Each device in (eg, device 101, device 102, or device 103) may adopt Figure 2 The structure shown, or including Figure 2 Parts shown. Figure 2 FIG. 2 is a schematic diagram of the hardware structure of an electronic device applicable to the present application. The electronic device 200 includes a processor 210 and a memory 221. Figure 1 The device 101 in the embodiment, the electronic device 200 further includes a display screen 290; if the electronic device 200 is Figure 1 The device 102 in the embodiment of the present invention, the electronic device 200 further includes a camera 291. Optionally, the electronic device 200 further includes at least one of the following: an external memory interface 220, a universal serial bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a sensor module 280, an indicator 292, or a subscriber identification module (SIM) card interface 293, etc. The following is a detailed introduction.

[0095] The processor 210 may include one or more processing units, for example, the processor 210 may include one or more of the following: an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, a neural network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated into one or more processors. The controller may generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions.

[0096] Optionally, a memory may be provided in the processor 210 for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may store instructions or data that the processor 210 has just used or cyclically used. If the processor 210 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 210, and thus improves the efficiency of the system.

[0097] In some embodiments, the processor 210 may include one or more interfaces. The interface may include one or more of the following interfaces: an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2C) interface, 2 S) interface, pulse code modulation (PCM) interface, universal asynchronous receiver / transmitter (UART) interface, mobile industry processor interface (MIPI), general-purpose input / output (GPIO) interface, SIM interface, USB interface, etc.

[0098] The charging management module 240 is used to receive charging input from a charger, where the charger can be a wireless charger or a wired charger.

[0099] The power management module 241 is used to connect the battery 242, the charging management module 240 and the processor 210. The power management module 241 receives input from the battery 242 and / or the charging management module 240 to power the processor 210, the memory 221, the display screen 290, the camera 291, and the wireless communication module 260.

[0100] The wireless communication function of the electronic device 200 can be implemented by antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, modulation and demodulation processor and baseband processor. Among them, antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antenna. The mobile communication module 250 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 200. The wireless communication module 260 can provide solutions for wireless communications including wireless local area networks (WLAN) (such as Wi-Fi networks), Bluetooth, global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc. applied to the electronic device 200.

[0101] The electronic device 200 implements the display function through a GPU, a display screen 290, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 290 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 210 may include one or more GPUs, which execute program instructions to generate or change display information.

[0102] The display screen 290 is used to display images, videos, etc. The display screen 290 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 200 may include 1 or n display screens 290, where n is a positive integer greater than 1.

[0103] The electronic device 200 can realize the shooting function through ISP, camera 291, video codec, GPU, display screen 290 and application processor.

[0104] The ISP is used to process the data fed back by the camera 291. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP can be set in the camera 291.

[0105] The camera 291 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 200 may include 1 or n cameras 291, where n is a positive integer greater than 1.

[0106] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 200 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0107] The external memory interface 220 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 200. The external memory card communicates with the processor 210 through the external memory interface 220 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0108] The memory 221 can be used to store computer executable program codes, which include instructions. The memory 221 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 200 (such as audio data, a phone book, etc.), etc. In addition, the memory 221 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 210 executes various functional applications and data processing of the electronic device 200 by running instructions stored in the memory 221, and / or instructions stored in a memory provided in the processor.

[0109] The electronic device 200 can implement audio functions through the audio module 270 and the application processor, such as music playing, recording, etc. The audio module 270 may include a speaker, a receiver, a microphone, an earphone interface, etc.

[0110] The sensor module 280 may include one or more sensors for implementing corresponding functions. For example, the sensor module 280 includes at least one of the following: a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0111] Indicator 292 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0112] The SIM card interface 293 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 200 by inserting the SIM card interface 293 or pulling the SIM card interface 293 out. The electronic device 200 can support 1 or n SIM card interfaces, where n is a positive integer greater than 1. The SIM card interface 293 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Optionally, in some electronic devices equipped with an eSIM function, the SIM card interface 293 may not be included.

[0113] It is understandable that the structure illustrated in the present application does not constitute a specific limitation on the electronic device 200. In other embodiments of the present application, the electronic device 200 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0114] The method provided by the present application will be described below in conjunction with the accompanying drawings. Each device in the following embodiments may have Figure 2 The parts shown are not described in detail.

[0115] It is understandable that in the present application, " / " can indicate that the objects associated with each other are in an "or" relationship, for example, A / B can indicate A or B; "and / or" can be used to describe that there are three relationships between the associated objects, for example, A and / or B can indicate: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. In addition, expressions similar to "at least one of A, B and C" or "at least one of A, B or C" are usually used to indicate any of the following: A exists alone; B exists alone; C exists alone; A and B exist at the same time; A and C exist at the same time; B and C exist at the same time; A, B and C exist at the same time. The above uses A, B and C as an example to illustrate the optional items of the item. When there are more elements in the expression, the meaning of the expression can be obtained according to the above rules.

[0116] In order to facilitate the description of the technical solution of the present application, in the present application, words such as "first" and "second" may be used to distinguish between technical features with the same or similar functions. The words such as "first" and "second" do not limit the quantity and execution order, and the words such as "first" and "second" do not necessarily limit them to be different. In the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations, and any embodiment or design described as "exemplary" or "for example" should not be interpreted as being more preferred or more advantageous than other embodiments or designs. The use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete way for easy understanding.

[0117] It is understood that the "embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, the various embodiments in the entire specification do not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It is understood that in various embodiments of the present application, the size of the sequence number of each process does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the present application.

[0118] It can be understood that in the present application, "when...", "in the case of...", "if" and "if" all mean that corresponding processing will be taken under certain objective circumstances, but do not limit the time, nor do they require any judgment action when implementing them, nor do they mean the existence of other limitations.

[0119] The term “simultaneously” in the present application may be understood as at the same time point, within a period of time, or within the same cycle.

[0120] In the present application, "a plurality of" may be understood as two or more than two. For example, a plurality of signals may be understood as two or more than two signals.

[0121] In this application, "greater than or equal to" can be replaced by "greater than" or "equal to"; "less than or equal to" can be replaced by "less than" or "equal to". For example, A is greater than or equal to B, which can be replaced by A is greater than B, or A is equal to B; A is less than or equal to B, which can be replaced by A is less than B, or A is equal to B.

[0122] It is understandable that some optional features in this application may be implemented independently in some scenarios without relying on other features, such as the solution on which it is currently based, to solve corresponding technical problems and achieve corresponding effects. They may also be combined with other features according to needs in some scenarios. Accordingly, the device provided in this application may also realize these features or functions accordingly, which will not be elaborated here.

[0123] It can be understood that the same step or steps or technical features with the same functions in different embodiments of the present application can be referenced to each other.

[0124] Below Figure 1 The device 101 and the device 102 in the example are used as the execution subject of the interaction diagram to illustrate the short-distance communication method provided by the present application, but the present application does not limit the execution subject of the interaction diagram. For example, the device (such as device 101 or device 102) in the method provided in the following embodiments of the present application may also be a chip, a chip system, or a processor that supports the device to implement the method, or a logical node, a logical module, or software that can implement all or part of the device functions.

[0125] It is understandable that in the present application, the device 101 and / or the device 102 may perform some or all of the steps in the present application, and these steps are only examples, and the present application may also perform other steps or variations of various steps. In addition, the various steps may be performed in different orders presented in the present application, and it may not be necessary to perform all of the steps in the present application.

[0126] like Figure 3 As shown, a short-distance communication method provided by the present application may include the following steps:

[0127] S301: The device 101 turns on the screen communication function.

[0128] In the present application, the screen communication function can integrate the information to be sent into the multiple frames of images displayed on the screen, so that the device with a camera function (such as device 102) can recover the information to be sent by scanning and demodulating these images, thereby realizing the "sending" of the information to be sent to the device with a camera function. In the present application, "scanning" can be replaced by "shooting", "recording", etc., without limitation.

[0129] In a possible implementation, the device 101 may enable the screen communication function in response to a user operation. For example, the user triggers the device 101 to enable the screen communication function by pressing a button, clicking, performing a gesture, or performing a voice control operation.

[0130] In another possible implementation, device 101 turns on the screen communication function according to the received instruction. For example, device 102 or device 103 sends a first instruction message to device 101. The first instruction message indicates to turn on the screen communication function. After receiving the first instruction message, device 101 turns on the screen communication function. It can be understood that if device 102 and device 101 are in the same network, device 102 can broadcast the first instruction message to the devices in the network; or, if device 102 and device 101 access the network through device 103, device 102 can forward the first instruction message to device 101 through device 103.

[0131] It is understandable that S301 is an optional step. For example, if the screen communication function is turned on when the device 101 leaves the factory, the device 101 may not execute S301. For another example, if the user has set the screen communication function of the device 101 to be turned on, the device 101 may not execute S301.

[0132] S302: The device 101 obtains a first digital sequence based on the information to be sent.

[0133] In the present application, the information to be sent is information that the device 101 wants to transmit to a device other than the device 101 (such as the device 102). Exemplarily, the information to be sent includes, but is not limited to, one or more of a password (such as a personal identification number (PIN) code, etc.), a QR code, a barcode, information of the device 101 (such as the identification and version of the device 101, etc.), or a website, etc. The information to be sent can be generated by the device 101 (such as a QR code, barcode, or PIN code generated by the device 101), stored locally (such as information of the device 101), or obtained from other devices (such as the device 103 generates a PIN code for the device 101 and sends it to the device 101, or obtains information such as a website from a server of a third-party application).

[0134] In a possible implementation, the device 101 modulates the information to be sent at a first bandwidth and a first frequency to obtain a first digital sequence. The first digital sequence may indicate N signals, where N is an integer greater than 1. For example, the device 101 may perform digital baseband modulation on the information to be sent to obtain a first bit sequence, and perform phase modulation on the first bit sequence at a first bandwidth and a first frequency to obtain a first digital sequence. The digital baseband modulation may be, for example, non-return to zero (NRZ) modulation, differential code modulation, or return to zero code modulation. Phase modulation may be, for example, binary phase shift keying (BPSK), differential binary phase shift keying (DBPSK), or quadrature phase shift keying (QPSK), etc., without limitation. The first bandwidth is the modulation bandwidth of the first digital sequence, for example, the first bandwidth is [20 Hz, 40 Hz], and the first frequency is the modulation frequency of the first digital sequence, for example, the first frequency is 30 Hz. In addition, in the present application, "signal" can be replaced by "chip" and the like, without limitation. The device 101 can also perform amplitude modulation on the first bit sequence to obtain a first digital sequence. The following embodiments of the present application are introduced by taking phase modulation as an example.

[0135] For example, taking the first bit sequence as "101", N as 12, and the modulation mode as BPSK, the first digital sequence can be as follows: Figure 4A As shown. Figure 4A In the example, the signal is represented by "high level" or "low level", the first bit sequence includes 3 bits, each bit corresponds to 4 signals, wherein one bit value corresponds to 4 carrier cycles, for example, "1" can be represented by 4 signals of "high-low-high-low", and "0" can be represented by 4 signals of "low-high-low-high". It should be understood that Figure 4A This is only an example of the first digital sequence. In a specific application, the first digital sequence may also be expressed in other forms, or the first digital sequence may include more than Figure 4A More or fewer signals are shown, without limitation.

[0136] It can be understood that when phase modulation is performed, the modulation frequency is usually not greater than half of the current refresh rate of the screen. Therefore, the first frequency is less than or equal to half of the screen refresh rate of device 101. Because the higher the modulation frequency, the more "transparent" the information of the N signals fused in the N-frame first image is to the user. Therefore, if the first frequency is equal to half of the screen refresh rate of device 101, the user's perception of the N signals fused in the N-frame first image can be minimized. If the first frequency is less than the screen refresh rate of device 101, the computing power of device 101 can be saved and power consumption can be reduced. In the present application, the unit of the screen refresh rate and the shooting frame rate described below (such as the first shooting frame rate) can be the number of frames per second (FPS).

[0137] S303: The device 101 continuously displays N frames of the first image on the screen.

[0138] In the present application, N frames of first images correspond to N consecutive frames of second images respectively, for example, the i-th frame of first image corresponds to the i-th frame of second image, and i is an integer greater than 1 and less than or equal to N. The N-frame second image is the image displayed on the screen of the device 101 when the screen communication function is not turned on. The user's visual perception result of the N-frame first image is the same as the user's visual perception result of the N-frame second image. In other words, for the user, the i-th frame of second image is the same as the i-th frame of first image. In this way, the user's use of the device 101 can be unaffected.

[0139] It is understandable that when two different colors flicker alternately, but the brightness does not change much, and the flickering frequency is greater than a certain value, the human eye sees the fused color and cannot perceive the color flicker. Based on this principle, constraints can be designed for the first image so that the user's visual perception results for N frames of the first image are the same as the user's visual perception results for N frames of the second image.

[0140] In a possible design, the screen refresh rate of the device 101 is greater than or equal to the first threshold; the absolute value of the difference between the brightness of the first pixel in the first image of the i-th frame and the brightness of the first pixel in the second image of the i-th frame is less than or equal to the second threshold; the absolute value of the difference between the first color information and the second color information is less than or equal to the third threshold. Among them, the first threshold can make the user unable to perceive the screen flicker. For example, the first threshold is 15HZ, 16HZ or 20HZ. The first pixel is any pixel on the screen of the device 101. The first color information is the color information of the first pixel in the first image of M consecutive frames in N frames, and the second color information is the color information of the first pixel in the second image of M frames corresponding to the first image of M frames, M is an integer greater than 1 and less than or equal to N, for example, M is equal to the carrier period of the first digital sequence (such as 2 frames). The second threshold and the third threshold can make the user's visual perception effect of the second image of the i-th frame the same as the user's visual perception effect of the first image of the i-th frame.

[0141] In addition, in order to enable the device 101 to “send” the information to be sent, N frames of first images may carry information of N signals.

[0142] In a possible design, the change law of the color information of the N frames of the first image is related to the change law of the N signals. Exemplarily, within the first bandwidth, the change law of the color information of the N frames of the first image is related to the change law of the N signals in the frequency domain, and / or, the change law of the color information of the N frames of the first image is related to the change law of the N signals in the time domain. In some embodiments, the change law of the color information of the N frames of the first image maintains the same or similar change trend as the change law of the N signals in the frequency domain, or the change law of the color information of the N frames of the first image is the same as the change law of the N signals in the frequency domain. In some embodiments, the change law of the color information of the N frames of the first image is linearly related to the change law of the N signals in the time domain, and the change law of the color information of the N frames of the first image is in a coefficient relationship with the change law of the N signals in the time domain, and the coefficient can be a positive number or a negative number. In this way, the information of the N signals can be fused into the color information of the N frames of the first image, so that after the device 102 scans these first images and demodulates them, it can recover the information to be sent. The color information of the first image of the i-th frame indicates the color accumulation value of the pixels in the i-th frame or the color average value of the pixels in the i-th frame. For example, the color information of the first image of the i-th frame is the sum of the color values ​​of all or part of the pixels in the i-th frame, or the sum of the color values ​​of all or part of the pixels in the i-th frame divided by the number of pixels participating in the “sum” operation in the i-th frame.

[0143] Optionally, the variation law of the brightness information of the N frames of the first image is related to the variation law of the N signals. Exemplarily, within the first bandwidth, the variation law of the brightness information of the N frames of the first image is related to the variation law of the N signals in the frequency domain, and / or, the variation law of the brightness information of the N frames of the first image is related to the variation law of the N signals in the time domain. In some embodiments, the variation law of the brightness information of the N frames of the first image maintains the same or similar variation trend as the variation law of the N signals in the frequency domain, or the variation law of the brightness information of the N frames of the first image is the same as the variation law of the N signals in the frequency domain. In some embodiments, the variation law of the brightness information of the N frames of the first image is linearly related to the variation law of the N signals in the time domain, and the variation law of the brightness information of the N frames of the first image is in a coefficient relationship with the variation law of the N signals in the time domain, and the coefficient can be a positive number or a negative number. In this way, in addition to the color information of the N frames of the first image, the information of the N signals can also be fused into the brightness information of the N frames of the first image. The brightness information of the i-th frame of the first image indicates the accumulated brightness value of the pixels in the i-th frame of the first image, or indicates the average brightness value of the pixels in the i-th frame of the first image.

[0144] It can be seen from the above description that the i-th frame of the first image is essentially obtained by fusing the i-th frame of the second image and the i-th signal. For example, the device 101 can obtain N frames of the second image, fuse the N signals with the N frames of the second image respectively, and continuously display the N frames of the first image on the screen of the device 101. It can be understood that the fusion operation of the signal and the second image can be performed by the CPU of the device 101, or by the GPU of the device 101, or by the CPU and GPU of the device 101. Taking the fusion operation performed by the GPU as an example, in Figure 4B In the embodiment, the CPU of the device 101 obtains the signal and the second image, and inputs the signal and the second image into the GPU, so that the GPU fuses the signal and the second image, and inputs the fused first image into the display.

[0145] In the following, N and M are equal to 2, and the first signal is "high level". Indicates that the second signal is "low level", with Indicates that the red, green, blue (RGB) values ​​of the second image in the first frame are expressed as Indicates that the RGB value of the second image in the second frame is expressed as Indicates that the RGB value of the first image in the first frame is expressed as Indicates that the RGB value of the first image in the second frame is expressed as Indicates that the LAB value of the second image in the first frame is Indicates that the LAB value of the second image in the second frame is Indicates that the LAB value of the first image in the first frame is Indicates that the LAB value of the first image in the second frame is Representation is used as an example to introduce the constraints of the first image.

[0146] in, and is a spatial matrix of RGB space, with a total of (H×W×Y) dimensions. i is equal to 1 or 2, H represents the screen height of device 101, W represents the screen width of device 101, and Y is equal to 3, corresponding to R, G, and B, respectively. H is the actual height of the screen or the height after downsampling, and similarly, W is the actual width of the screen or the width after downsampling. It can be expressed as It can be expressed as in this case, It can also be viewed as a spatial matrix with a total of (H×W×Y) dimensions. It can be expressed as In other words, Treated as a communication layer. and It is the space matrix of the color space specified by the International Commission on Illumination (CIE) L*A*B (CIELAB) (hereinafter referred to as CIELAB space), with a total of (H×W×Z) dimensions, where Z is equal to 3, corresponding to lightness (L), A, and B. A represents the component from green to red in the CIELAB space, and B represents the component from blue to yellow in the CIELAB space. It should be understood that the meaning of B (representing blue) in the RGB space is different from the meaning of B (representing the component from blue to yellow in the CIELAB space) in the CIELAB space. It can be expressed as It can be expressed as Wherein, (k, l) is a pixel on the screen of device 101.

[0147] Example 1: Device 101 will Convert from RGB space to CIELAB space and get By changing middle and The value of The change rule of the color information of the N frames of the first image is related to the change rule of the N signals. Exemplarily, the screen refresh rate of the device 101 is greater than or equal to the first threshold, and and The following relationships (1) to (4) are satisfied, so that the user's visual perception results of the N frames of the first image are the same as the user's visual perception results of the N frames of the second image, and the change pattern of the color information of the N frames of the first image is related to the change pattern of the N signals.

[0148] (1) L max represents the second threshold. For example, and

[0149] (2) A max represents the third threshold, and B max represents the third threshold, A max and B max Can be the same or different.

[0150] (3)

[0151] (4) Ensure that the first image corresponding to the "high level" (the first image of the first frame in this example) is different from the first image corresponding to the "low level" (the first image of the second frame in this example) so that the device 102 can recover the information to be sent. Among them, CONS1, CONS2, CONS3, CONS4, CONS5, CONS6 are constants, CONS1, CONS2 and CONS3 can be the same or different, CONS4, CONS5 and CONS6 can be the same or different, but CONS1 and CONS4 are different, CONS2 and CONS5 are different, CONS3 and CONS6 are different. It can be understood that the color information of the first image of the first frame can be expressed as [CONS1, CONS2, CONS3], and the color information of the first image of the second frame can be expressed as [CONS4, CONS5, CONS6].

[0152] by Figure 5A Taking the first digital sequence shown as an example, the first digital sequence indicates 120 signals, the first frequency is 30Hz, the first bandwidth is 20Hz-40Hz, and the RGB values ​​of the 120 frames of the second image remain unchanged or change little. In one case, the change rules of the R channel, G channel and B channel of the 120 frames of the first image in the time domain are respectively related to the change rules of the 120 signals. Specifically, it can be as follows Figure 5B In another case, within the bandwidth of 20 Hz to 40 Hz, the frequency domain variation law of the R channel of the 120 frames of the first image is related to the variation law of the 120 signals. Specifically, it can be as follows Figure 5CAs shown. It can be understood that the frequency domain change law of the G channel or B channel of the 120-frame first image is similar to that of the R channel, and is related to the change law of the 120 signals, so it will not be repeated. It should be understood that although the R channel, G channel and B channel all carry brightness information and color information, due to Therefore, it can be understood that the above-mentioned changing rules are the changing rules of color information and have little to do with brightness information.

[0153] Optionally, in Example 1, the N frames of the second image (or the N frames of the first image) are quasi-static images. The above relationships (1) and (2) can be transformed into the following relationship:

[0154] (1.1)

[0155] (2.1) and In this example, M is equal to 2.

[0156] Example 2: Device 101 does not perform conversion from RGB space to CIELAB space, but directly modulates according to the change rule of the high and low levels of the first digital sequence. For example, change In and / or, and / or, The value of Increase ΔR, Increase ΔG, Increase ΔB) so that the change law of the color information and brightness information of the N-frame first image is consistent with the change law of the N signals. Wherein, ΔR is a positive number, a negative number or zero, ΔG is a positive number, a negative number or zero, ΔB is a positive number, a negative number or zero, and ΔR, ΔG and ΔB are the same or different. It can be understood that in order to make the user's visual perception result of the N-frame first image the same as the user's visual perception result of the N-frame second image, the screen refresh rate of the device 101 is greater than or equal to the first threshold, and |ΔR+ΔG+ΔB|≤T, T is related to the second threshold and the third threshold. For example, T is determined to be 3 based on the second threshold and the third threshold. In addition, the device 101 must ensure that the first image corresponding to the "high level" (the first image of the first frame in this example) is different from the first image corresponding to the "low level" (the first image of the second frame in this example), so that the device 102 can recover the information to be sent. For example, let

[0157] by Figure 5A The first digital sequence shown and Figure 5DTaking the color information and brightness information of the 120 frames of the second image as an example, the first digital sequence indicates 120 signals, the first frequency is 30Hz, the first bandwidth is 20Hz-40Hz, and the accumulated value (or average value) of the R channel of the 120 frames of the second image, the accumulated value (or average value) of the G channel, and the accumulated value (or average value) of the B channel show an upward trend. In one case, the change law of the R channel of the 120 frames of the first image in the time domain is related to the change law of the 120 signals. Specifically, it can be as follows Figure 5E As shown. It can be understood that the time domain variation law of the G channel or B channel of the 120-frame first image is similar to that of the R channel, and is related to the variation law of the 120 signals, so it will not be described in detail. In another case, within the bandwidth of 20Hz to 40Hz, the frequency domain variation law of the R channel of the 120-frame first image is related to the variation law of the 120 signals. Specifically, it can be as follows Fig. 5F As shown. It can be understood that the frequency domain variation law of the G channel or the B channel of the 120-frame first image is similar to that of the R channel, and is related to the variation law of the 120 signals, so it will not be described in detail. In addition, since the R channel, the G channel, and the B channel all carry brightness information and color information, it can be understood that the above variation law is the variation law of color information and brightness information.

[0158] Optionally, in Example 2, the N frames of second images (or the N frames of first images) are dynamically changing images, such as when the device 101 is playing a video.

[0159] It can be understood that the above examples 1 and 2 are merely examples of the constraint conditions of the first image. In specific applications, the constraint conditions of the first image may also have other forms, which are not limited.

[0160] Optionally, the device 101 may play N frames of the first image in a loop.

[0161] S304: The device 102 scans the N frames of the first image displayed on the screen of the device 101 through the camera function, and demodulates the first image to obtain the information to be received.

[0162] In a possible implementation, the device 102 turns on the camera function, scans N frames of the first image displayed on the screen of the device 101 through the camera function, obtains V frames of the third image, and demodulates the V frames of the third image to obtain the information to be received. V is an integer greater than 1. V is the same as or different from N. It can be understood that V is related to the shooting frame rate of the device 102 and N. The information to be received is the information to be sent restored by the device 102.

[0163] Exemplarily, the device 102 turns on the camera function in response to the user's operation. For example, the user triggers the device 102 to turn on the camera function through operations such as buttons, clicks, gestures, or voice control. The user can also set the parameters of the camera function. For example, the user triggers the device 102 to turn on the camera function according to the parameters corresponding to the communication mode through gestures or voice corresponding to the communication mode. Among them, the parameters of the camera function may include shooting frame rate. Optionally, the parameter also includes at least one of focal length, sensitivity, or exposure time. Optionally, the focal length can be set to a fixed value D to prevent moiré, where D is the focal length corresponding to slight underfocus or slight overfocus. Taking the positive focus equal to 20 cm as an example, D can be set to less than 20 cm or greater than 20 cm. The exposure time can be much less than 1 / T P , where T P is the sampling interval of the device 102. P is the reciprocal of the shooting frame rate. Afterwards, the device 102 guides the user (such as guiding the user through text or voice) to aim the camera at the screen of the device 101, and scans N frames of the first image to obtain V frames of the third image. For example, prompt information may be displayed on the screen of the device 102, such as one or more items such as the captured picture, the length of time that has been shot, whether the shooting can be stopped, or whether the shooting angle is correct. When the scanning time is greater than or equal to the preset time, the device 102 performs digital signal processing and demodulation on the third image obtained by scanning, and recovers the information to be sent. It is understandable that if the device 102 fails to recover the information to be sent, it can guide the user to rescan. The device 102 can also prompt the user the reason for the failure, such as the scanning time is too short or the jitter is severe.

[0164] It can be understood that after the device 102 performs image processing on the V-frame third image, V signals can be obtained. Since the change rule of the color information of the N-frame first image is related to the change rule of the N signals, or the change rule of the color information and brightness information of the N-frame first image is related to the change rule of the N signals, and the V-frame third image is obtained by scanning the N-frame first image, the change rule of the V signals is related to the change rule of the N signals. Therefore, the device 102 demodulates the V signals and can recover the information to be sent.

[0165] The actions of the device 101 or the device 102 in the above S301-S304 can be performed by Figure 2 The processor 210 in the electronic device 20 shown calls the application code stored in the memory 221 for execution, and the present application does not impose any limitation on this.

[0166] based on Figure 3According to the method shown, device 101 can modulate the information to be sent onto the N-frame first image displayed by device 101. For the user, the information to be sent integrated into the first image is "transparent", which is not perceived by the user and does not affect the user's use of device 101. For device 102, the information to be sent integrated into the first image is not "transparent", and the information to be sent can be restored by scanning the N-frame first image and demodulating it, thereby realizing "communication" between device 101 and device 102. In addition, the light has good directivity, so the device to be "communicated" can be selected by adjusting the direction of the camera of device 102, without the user manually searching for the device, and the operation is simple, and the directivity is good, which can improve the user experience.

[0167] Optional, in Figure 3 In a possible implementation of the method shown, the first image may be divided into regions (e.g., regions are divided according to the color gamut distribution of the first image), and different signals are fused into each region. In this way, the device 102 scans a frame of the first image and can demodulate multiple signals, which can shorten the time it takes for the device 102 to scan the first image.

[0168] In a possible design, each frame of the first image includes P regions, and the positions and sizes of the P regions included in any two frames of the first image are the same. The first digital sequence also indicates (P-1)*N signals, that is, the first digital sequence indicates a total of P*N signals. The first digital sequence includes P segment sequences, each segment sequence indicates N continuous signals among the P*N signals, the P regions correspond to the P segment sequences respectively, and the change law of the N frames of color information in each region is related to the change law of the N continuous signals corresponding to the region, and P is an integer greater than 1.

[0169] For example, taking P equal to 3 and N equal to 3 as an example, the first digital sequence includes 9 signals, namely signal 1 to signal 9, and the corresponding relationship between the regions in the 3 frames of the first image and the signals 1 to signal 9 can be as follows: Figure 6 As shown. Figure 6 In the figure, for the first frame of the first image, region 1 is fused with signal 1, region 2 is fused with signal 4, and region 3 is fused with signal 7. For the second frame of the first image, region 1 is fused with signal 2, region 2 is fused with signal 5, and region 3 is fused with signal 8. For the third frame of the first image, region 1 is fused with signal 3, region 2 is fused with signal 6, and region 3 is fused with signal 9. In other words, the change rule of the color information of the three frames in region 1 is related to the change rule of signal 1 to signal 3, the change rule of the color information of the three frames in region 2 is related to the change rule of signal 4 to signal 6, and the change rule of the color information of the three frames in region 3 is related to the change rule of signal 7 to signal 9.

[0170] Optionally, the variation rule of the N frames of brightness information in each region is related to the variation rule of the N continuous signals corresponding to the region. Figure 6 Taking the first image shown as an example, the changing pattern of the 3 frames of brightness information in area 1 is related to the changing pattern of signal 1 to signal 3, the changing pattern of the 3 frames of brightness information in area 2 is related to the changing pattern of signal 4 to signal 6, and the changing pattern of the 3 frames of brightness information in area 3 is related to the changing pattern of signal 7 to signal 9.

[0171] Optionally, different regions correspond to different fusion methods, so as to take into account the characteristics of different regions at the same time and improve the user experience. Exemplarily, if each frame of the first image includes 2 regions, region 2 is the video window on the desktop of device 101, and region 1 is the part of the desktop other than the video window, then region 1 fuses the signal in the manner of example 1 above, and region 2 fuses the signal in the manner of example 2 above. In this way, the playback speed of the dynamic image can be taken into account, and the user will not feel the video freeze, and the modulation depth of the static image can be taken into account, so that the first image seen by the user is closer to the second image.

[0172] Optional, in Figure 3 In one possible implementation of the method shown, in order to facilitate the device 102 to determine the N-frame first image in the scanned image, the device 101 can merge the synchronization sequence into the R-frame first image displayed on the screen, so that the device 102 determines the N-frame first image based on the R-frame first image.

[0173] In a possible implementation, the device 101 acquires a synchronization sequence and continuously displays the R-frame first image on the screen.

[0174] In the present application, the synchronization sequence may indicate R signals, where R is an integer greater than 1. The synchronization sequence is modulated on a second frequency, where the second frequency is different from the first frequency, for example, the second frequency is less than the first frequency. The synchronization sequence may be pre-stored in the device 101, or the device 101 modulates the synchronization information to obtain the synchronization sequence. For example, the device 101 uses a carrier frequency f c = 1 to 2 carrier cycle lengths of 20 Hz modulate the synchronization information to obtain a synchronization sequence. The process of device 101 modulating the synchronization information to obtain the synchronization sequence is similar to the process of device 101 modulating the information to be sent to obtain the first digital sequence, and reference may be made to the corresponding description in S302, which will not be repeated here.

[0175] In the present application, the R frame first image corresponds to the continuous R frame second image respectively, and the R frame second image is the image displayed on the screen of the device 101 when the screen communication function of the device 101 is not turned on. The visual perception result of the user for the R frame first image is the same as the visual perception result of the user for the R frame second image. The change law of the color information of the R frame first image is related to the change law of the R signals. The color information of the j-th frame first image indicates the color accumulation value of the pixel point in the j-th frame first image, and j is an integer greater than 1 and less than or equal to R. The relationship between the R frame first image, the R frame second image and the R signals is similar to the relationship between the N-frame first image, the N-frame second image and the N signals. Please refer to the corresponding description in S303, which will not be repeated here.

[0176] It can be understood that the time period during which the R frame first image is displayed on the screen of the device 101 is different from the time period during which the N frame first image is displayed on the screen of the first device. For example, the R frame first image is displayed before the N frame first image, and the R+1 frame displays the 1st frame first image in the N frames. In this way, the device 102 can determine the position of the 1st frame first image in the N frames according to the R frame first image when scanning the R frame first image and the N frame first image, and then determine the N frame first image. For another example, the R frame first image is displayed after the N frame first image, and the N+1 frame displays the 1st frame first image in the R frame. In this way, the device 102 can determine the position of the Nth frame first image in the N frames according to the R frame first image when scanning the R frame first image and the N frame first image, and then determine the N frame first image.

[0177] It can be understood that in order to solve the inverse pi problem, R signals can be configured to correspond to Z signals among N signals, where Z is an integer greater than 1 and less than N. For example, the R signals correspond to the first Z signals among the N signals, so that the device 102 determines the bit values ​​corresponding to the first N signals among the N signals according to the R signals.

[0178] It can be understood that if the first image is divided into regions, the synchronization sequences corresponding to different regions may be the same or different.

[0179] Optional, in Figure 3In a possible implementation of the method shown, device 101 and device 102 may be connected to the same network, such as a first network. Device 101 may obtain a first shooting frame rate, and set the screen refresh rate of device 101 according to the first shooting frame rate, for example, setting the screen refresh rate of device 101 equal to the first shooting frame rate. The first shooting frame rate is the lowest shooting frame rate among the shooting frame rates supported by the device with a camera function in the first network, and the shooting frame rate supported by the device with a camera function in the first network may be the maximum shooting frame rate supported by the device, the minimum shooting frame rate, the shooting frame rate corresponding to a certain shooting scene, or the commonly used shooting frame rate, etc., without limitation. Device 102 may obtain the first shooting frame rate, and set the shooting frame rate of the camera function according to the first shooting frame rate, for example, setting the shooting frame rate of the camera function to be greater than or equal to the first shooting frame rate. In this way, the shooting frame rate of the camera function of device 102 may be greater than or equal to the screen refresh rate of device 101, so that device 102 scans N frames of the first image and obtains V frames of the third image. In the present application, the shooting frame rate of the camera function of the device 102 may be equal to the first shooting frame rate, or equal to 2 times, 3 times, 4 times or 5 times, etc. of the first shooting frame rate.

[0180] Optionally, the device 102 may send second indication information to a device in the first network for determining the first shooting frame rate, such as the device 103, where the second indication information indicates a shooting frame rate supported by the device 102, so that the device 103 determines the first shooting frame rate. The shooting frame rate supported by the device 102 includes at least one of a maximum shooting frame rate supported by the device 102, a minimum shooting frame rate supported by the device 102, or a shooting frame rate commonly used by the device 102.

[0181] For example, the first network includes a smart screen (corresponding to the above device 101), a mobile phone (corresponding to the above device 102), a whole-house smart host (corresponding to the above device 103) and a pad as an example to introduce the above devices accessing the first network. Figure 7As shown, the pad is the first device to access the network. After the pad accesses the first network, it sends the shooting frame rate 1 to the whole house smart host. After receiving the shooting frame rate 1, the whole house smart host determines the shooting frame rate 1 as the first shooting frame rate. After the smart screen accesses the first network, the whole house smart host sends the shooting frame rate 1 to the smart screen, so that the smart screen sets the screen refresh rate according to the shooting frame rate 1 after turning on the screen communication function. After the mobile phone accesses the first network, it sends the shooting frame rate 2 to the whole house smart host. If the shooting frame rate 2 is less than the shooting frame rate 1, after receiving the shooting frame rate 2, the whole house smart host determines the shooting frame rate 2 as the first shooting frame rate, and sends the shooting frame rate 2 to the smart screen, so that the smart screen sets the screen refresh rate according to the shooting frame rate 2 after turning on the screen communication function. The whole house smart host also sends the shooting frame rate 2 to the pad, so that the pad sets the screen refresh rate according to the shooting frame rate 2 after turning on the screen communication function, or so that the pad sets the shooting frame rate of the camera module according to the shooting frame rate 2 when communicating with the smart screen. It is understandable that if the mobile phone subsequently exits the first network, the whole-house smart host can re-determine the first shooting frame rate in the first network.

[0182] In order to better understand the method provided by this application, the following takes the information to be sent as a PIN code, and the first network includes a smart screen (corresponding to the above device 101), a mobile phone (corresponding to the above device 102), a whole house smart host (corresponding to the above device 103) and a pad as an example to introduce the complete process of the short-distance communication method provided by this application. It should be understood that the following Figure 8 The description of each feature and step in the method shown is applicable to the above Figure 3 The method shown above Figure 3 The description of each feature and step in the method shown is also applicable to the following Figure 8 The method shown.

[0183] like Figure 8 As shown, another short-distance communication method provided by the present application may include the following steps:

[0184] S801: The whole-house smart host synchronizes the first shooting frame rate to the smart screen, mobile phone and pad respectively.

[0185] The specific process of S801 can refer to the above Figure 7 The corresponding description is omitted here.

[0186] Optionally, the whole-house smart host also generates a corresponding PIN code for the screen device in the first network, obtains a PIN code table, and synchronizes the PIN code table to the smart screen, mobile phone, and pad respectively. In this example, the PIN code table includes the PIN code of the smart screen, the PIN code of the pad, and the PIN code of the mobile phone. For example, the PIN code table is shown in Table 1. In Table 1, the PIN code of the smart screen is 654-555, the PIN code of the pad is 654-154, and the PIN code of the mobile phone is 334-144.

[0187] Table 1

[0188] Equipment identification PIN Smart Screen 654-555 pad 654-154 cell phone 334-144

[0189] S802: The mobile phone broadcasts first instruction information in the first network, indicating to turn on the screen communication function. Correspondingly, the smart screen and the pad receive the first instruction information respectively.

[0190] It can be understood that when a mobile phone user wants to communicate with a device with a screen in the first network, the mobile phone can be triggered to broadcast the first indication information in the first network.

[0191] S803: The smart screen turns on the screen communication function, obtains a first digital sequence based on the PIN code of the smart screen, and displays N frames of the first image on the screen.

[0192] S804: The pad turns on the screen communication function, obtains a first digital sequence based on the PIN code of the pad, and displays N frames of the first image on the screen.

[0193] It is understandable that the processes of S803 and S804 are similar to the processes of S301-S303. For details, please refer to the corresponding descriptions in S301-S303. It should be understood that the first digital sequence modulated by the smart screen is different from the first digital sequence modulated by the pad, and the N-frame first image displayed on the smart screen is also different from the N-frame first image displayed on the pad.

[0194] It is understandable that the present application does not limit the execution order of S803-S804. For example, S803 may be executed first and then S804, or S804 may be executed first and then S803, or S803 and S804 may be executed simultaneously.

[0195] S805: The user gesture triggers the mobile phone to turn on the camera function and set corresponding parameters.

[0196] S806: The mobile phone displays prompt information 1 to guide the user to shoot the first image of N frames displayed on the smart screen, and demodulates it to obtain a set of PIN codes.

[0197] In this application, the prompt information 1 may include a camera preview interface and a shooting timing frame. The shooting time of the user is greater than or equal to a preset time so that the mobile phone can shoot a complete N-frame first image.

[0198] Optionally, the mobile phone calculates the confidence of the PIN code. For example, the mobile phone calculates the confidence of the PIN code based on the noise variance of the received signal and the noise power of the received signal. If the confidence is less than a threshold value, the mobile phone can guide the user to take a new photo. In this example, it is assumed that the confidence is greater than or equal to the threshold value.

[0199] S807: The mobile phone establishes a connection with the smart screen based on the PIN code.

[0200] A possible implementation method is that the mobile phone queries the PIN code table for the group of PIN codes. If the group of PIN codes is found, a connection is established with the smart screen based on the group of PIN codes. Optionally, if the connection is successful, the mobile phone also displays prompt information 2, such as successful connection; if the connection fails, the mobile phone can guide the user to reshoot. If not found, the mobile phone can guide the user to reshoot. Optionally, the mobile phone can also display prompt information 3 based on the demodulation information. For example, if the signal is weak during the demodulation process, the mobile phone can display that there is no target within the shooting range, and the mobile phone can subsequently guide the user to aim the camera at the target. If the shooting information is found to be incomplete during the demodulation process, the mobile phone can display that the shooting time is too short, and the mobile phone can subsequently guide the user to increase the shooting time. If the signal characteristics are found to change significantly during the demodulation process, the mobile phone can display that the shooting shakes violently, and the mobile phone can subsequently guide the user to shoot steadily.

[0201] In one possible implementation, the mobile phone establishes a connection with the smart screen via wireless methods such as WiFi or Bluetooth. For example, the mobile phone sends the set of PIN codes to the smart screen via WiFi or Bluetooth, and after the smart screen receives the set of PIN codes, it connects to the mobile phone according to the set of PIN codes.

[0202] It can be understood that if the center frequency f of the modulation signal c =30Hz, the lowest frequency of the modulation signal f l =15Hz, the screen refresh rate of the smart screen is 60FPS, and in the slow playback mode of the screen, the PIN code (6 digits) of the smart screen requires 20 bits, corresponding to 1.33 seconds of playback. Therefore, the method of the present application can enable the mobile phone to establish a connection with the smart screen within 1.5 seconds, with strong directionality and simple user operation. The range of the mobile phone scanning the smart screen can be about 1 meter or more than 1 meter, and the specific range is related to the size of the smart screen.

[0203] Optionally, the mobile phone may broadcast a third instruction message in the first network, indicating that the screen communication function is to be turned off.

[0204] Optionally, if the smart screen exits the first network, the whole house smart host can delete the PIN code of the smart screen and broadcast the latest PIN code table in the first network. If the mobile phone exits the first network, the whole house smart host can delete the PIN code of the mobile phone, update the first shooting frame rate, and broadcast the latest PIN code table and the updated first shooting frame rate in the first network. If the pad exits the first network, the whole house smart host can delete the PIN code of the pad, update the first shooting frame rate, and broadcast the latest PIN code table and the updated first shooting frame rate in the first network.

[0205] It is understandable that the actions of the whole-house smart host or mobile phone or smart screen or pad in the above S801-S807 can be Figure 2 The processor 210 in the electronic device 20 shown calls the application code stored in the memory 221 for execution, and the present application does not impose any limitation on this.

[0206] In some embodiments, when the user of a mobile phone wants to communicate with a device with a screen (such as a smart screen or pad) in the first network, the mobile phone can be triggered to communicate with device 103 (such as a whole-house smart host), and device 103 communicates with device 101 (such as a smart screen or pad), so that device 101 (such as a smart screen or pad) turns on the screen communication function.

[0207] The various embodiments mentioned above in this application can be combined without limitation if there is no contradiction between the solutions.

[0208] The above mainly introduces the scheme provided by the present application from the perspective of interaction between various devices. Accordingly, the present application also provides an electronic device, which may be the device 101 in the above method embodiment, or a device including the above device 101, or a component that can be used for the device 101; or, the electronic device may be the device 102 in the above method embodiment, or a device including the above device 102, or a component that can be used for the device 102. It is understandable that the above device 101 or device 102, etc., in order to realize the above functions, includes a hardware structure and / or software module corresponding to each function. Those skilled in the art should easily realize that, in combination with the units and algorithm operations of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0209] The present application can divide the functional modules of the device 101 or the device 102 according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. It can be understood that the division of modules in the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0210] For example, when the functional modules are divided in an integrated manner, Fig. 9 A schematic diagram of the structure of an electronic device 90 is shown. The electronic device 90 includes a processing module 901 and a display module 902. Optionally, the electronic device 90 also includes an interface module 903. The processing module 901, which may also be referred to as a processing unit, is used to perform operations other than transceiver operations and display operations, and may be, for example, a processing circuit or a processor. The display module 902, which may also be referred to as a display unit, is used to perform display operations, and may be, for example, a display screen. The interface module 903, which may also be referred to as an interface unit, is used to perform transceiver operations, and may be, for example, an interface circuit, a transceiver, a transceiver or a communication interface.

[0211] In some embodiments, the electronic device 90 may further include a storage module ( Fig. 9 ), for storing program instructions and data.

[0212] Exemplarily, the electronic device 90 is used to implement the functions of the device 101. The electronic device 90 is, for example, Figure 3 The device 101 of the embodiment shown, or Figure 8 The smart screen or pad described in the embodiment shown.

[0213] The processing module 901 is used to obtain a first digital sequence based on the information to be sent. The first digital sequence indicates N signals, where N is an integer greater than 1. For example, the processing module 901 can be used to execute S302.

[0214] The display module 902 is used to continuously display N frames of the first image on the screen of the first device. The N frames of the first image correspond to N consecutive frames of the second image respectively, and the N frames of the second image are images displayed on the screen of the first device when the screen communication function of the first device is not turned on. The visual perception result of the user for the N frames of the first image is the same as the visual perception result of the user for the N frames of the second image. The change rule of the color information of the N frames of the first image is related to the change rule of the N signals. The color information of the i-th frame of the first image indicates the color accumulation value of the pixel points in the i-th frame of the first image, and i is an integer greater than 1 and less than or equal to N. For example, the display module 902 can be used to execute S303.

[0215] In a possible implementation, a user's visual perception result of N frames of first images is the same as a user's visual perception result of N frames of second images, including: a screen refresh rate of the first device is greater than or equal to a first threshold; an absolute value of a difference between a brightness of a first pixel in the i-th frame of the first image and a brightness of the first pixel in the i-th frame of the second image is less than or equal to a second threshold, and the first pixel is any pixel on the screen of the first device; an absolute value of a difference between first color information and second color information is less than or equal to a third threshold, the first color information is color information of the first pixel in M ​​consecutive frames of first images in N frames, and the second color information is color information of the first pixel in M ​​frames of second images corresponding to M frames of first images, and M is an integer greater than 1 and less than or equal to N.

[0216] In a possible implementation manner, the processing module 901 is specifically configured to modulate the information to be sent at a first bandwidth and a first frequency to obtain a first digital sequence.

[0217] In a possible implementation, the changing law of color information of N frames of first images is related to the changing law of N signals, including: within a first bandwidth, the changing law of color information of N frames of first images is related to the changing law of N signals in frequency, or the changing law of color information of N frames of first images is related to the changing law of N signals in time domain.

[0218] In a possible implementation, the first frequency is less than or equal to half of a screen refresh rate of the first device.

[0219] In a possible implementation, the display module 902 is further used to continuously display R frame first images on the screen of the first device, the R frame first images respectively correspond to continuous R frame second images, the R frame second images are images displayed on the screen of the first device when the screen communication function of the first device is not turned on, the user's visual perception result of the R frame first image is the same as the user's visual perception result of the R frame second image, the change pattern of color information of the R frame first image is related to the change pattern of R signals, the color information of the j-th frame first image indicates the color accumulated value of the pixel points in the j-th frame first image, the R signals are signals indicated by the synchronization sequence, R is an integer greater than 1, j is an integer greater than 1 and less than or equal to R, and the time period for the R frame first image to be displayed on the screen of the first device is different from the time period for the N-frame first image to be displayed on the screen of the first device.

[0220] In a possible implementation manner, the processing module 901 is further configured to obtain a synchronization sequence, where the synchronization sequence is modulated on a second frequency, and the second frequency is different from the first frequency.

[0221] In a possible implementation, the display module 902 is specifically configured to fuse the N signals with the N frames of the second image respectively, and continuously display the N frames of the first image on the screen of the first device.

[0222] A possible implementation method is that each frame of the first image includes P areas, and the positions and sizes of the P areas included in any two frames of the first image are the same. The first digital sequence also indicates (P-1)*N signals. The first digital sequence includes P segment sequences, each segment sequence indicates N continuous signals among the P*N signals, and the P areas correspond to the P segment sequences respectively. The change law of the N frames of color information in each area is related to the change law of the N continuous signals corresponding to the area, and P is an integer greater than 1.

[0223] In a possible implementation manner, a variation pattern of brightness information of N frames of first images is related to a variation pattern of N signals.

[0224] In a possible implementation manner, the brightness information of the i-th frame of the first image indicates the brightness accumulation value of the pixel points in the i-th frame of the first image.

[0225] In a possible implementation, a changing law of brightness information of N frames of first images is related to a changing law of N signals, including: within a first bandwidth, a changing law of brightness information of N frames of first images is consistent with a changing law of N signals in the frequency domain, or a changing law of brightness information of N frames of first images is linearly correlated with a changing law of N signals in the time domain; and the first bandwidth is a modulation bandwidth of the first digital sequence.

[0226] A possible implementation method is that each frame of the first image includes P areas, and the positions and sizes of the P areas included in any two frames of the first image are the same. The first digital sequence also indicates (P-1)*N signals. The first digital sequence includes P segment sequences, each segment sequence indicates N continuous signals among the P*N signals, and the P areas correspond to the P segment sequences respectively. The change law of the N frames of brightness information in each area is related to the change law of the N continuous signals corresponding to the area, and P is an integer greater than 1.

[0227] In one possible implementation, the interface module 903 is used to access the first network; the processing module 901 is also used to obtain a first shooting frame rate, which is the lowest shooting frame rate among the shooting frame rates supported by the device with a camera function in the first network; the processing module 901 is also used to set the screen refresh rate of the first device according to the first shooting frame rate.

[0228] In a possible implementation, the interface module 903 is further configured to receive first indication information, where the first indication information indicates to enable the screen communication function.

[0229] When used to implement the functions of the device 101, for other functions that the electronic device 90 can implement, refer to Figure 3 The embodiment shown or Figure 8 The relevant introduction of the illustrated embodiment will not be repeated in detail.

[0230] In a simple embodiment, those skilled in the art will appreciate that the electronic device 90 may use Figure 2 For example, Figure 2 The processor 210 in the embodiment can call the computer execution instructions stored in the memory 221 to enable the electronic device 90 to execute the method described in the above method embodiment.

[0231] For example, Fig. 9 The functions / implementation processes of the processing module 901, the display module 902 and the interface module 903 can be Figure 2 The processor 210 in the embodiment calls the computer execution instructions stored in the memory 221 to implement. Or, Fig. 9 The function / implementation process of the processing module 901 in Figure 2 The processor 210 in the embodiment calls the computer execution instructions stored in the memory 221 to implement, Fig. 9 The function / implementation process of the display module 902 can be Figure 2 The display screen 290 is used to realize the Fig. 9 The function / implementation process of the interface module 903 in Figure 2 It is implemented by the mobile communication module 250 or the wireless communication module 260 in.

[0232] For example, when the functional modules are divided in an integrated manner, Fig.10 The schematic diagram of the structure of an electronic device 100 is shown. The electronic device 100 includes a processing module 1001. Optionally, the electronic device 100 also includes an interface module 1002. The processing module 1001, which may also be referred to as a processing unit, is used to perform operations other than transceiver operations, and may be, for example, a processing circuit or a processor. The interface module 1002, which may also be referred to as an interface unit, is used to perform transceiver operations, and may be, for example, an interface circuit, a transceiver, a transceiver or a communication interface.

[0233] In some embodiments, the electronic device 100 may further include a storage module ( Fig.10 ), for storing program instructions and data.

[0234] Exemplarily, the electronic device 100 is used to implement the function of the device 102. The electronic device 100 is, for example, Figure 3 The device 102 or Figure 8 The mobile phone described in the embodiment shown.

[0235] The processing module 1001 is used to scan N frames of first images displayed on the screen of the first device through the camera function, and demodulate to obtain the information to be received, where N is an integer greater than 1. For example, the processing module 1001 can be used to execute S304.

[0236] In a possible implementation method, the interface module 1002 is used to access the first network; the processing module 1001 is also used to obtain a first shooting frame rate, which is the lowest shooting frame rate among the shooting frame rates supported by the device with the camera function in the first network; the processing module 1001 is also used to set the shooting frame rate of the camera function according to the first shooting frame rate.

[0237] In a possible implementation, the interface module 1002 is further configured to send first indication information, where the first indication information indicates to enable the screen communication function.

[0238] In a possible implementation manner, the interface module 1002 is further configured to send second indication information, where the second indication information indicates a shooting frame rate supported by the second device.

[0239] When used to implement the function of the device 102, for other functions that the electronic device 100 can implement, refer to Figure 3 The embodiment shown or Figure 8 The relevant introduction of the illustrated embodiment will not be repeated in detail.

[0240] In a simple embodiment, those skilled in the art will appreciate that the electronic device 100 may use Figure 2 For example, Figure 2 The processor 210 in the electronic device 100 can call the computer execution instructions stored in the memory 221 to enable the electronic device 100 to execute the method described in the above method embodiment.

[0241] For example, Fig.10 The functions / implementation processes of the processing module 1001 and the interface module 1002 can be Figure 2 The processor 210 in the embodiment calls the computer execution instructions stored in the memory 221 to implement. Or, Fig.10 The function / implementation process of the processing module 1001 in Figure 2 The processor 210 in the embodiment calls the computer execution instructions stored in the memory 221 to implement, Fig.10 The function / implementation process of the interface module 1002 can be achieved by Figure 2 It is implemented by the mobile communication module 250 or the wireless communication module 260 in.

[0242] It is understandable that one or more of the above modules or units can be implemented by software, hardware or a combination of the two. When any of the above modules or units is implemented in software, the software exists in the form of computer program instructions and is stored in a memory, and a processor can be used to execute the program instructions and implement the above method flow. The processor can be built into an SoC (system on chip) or an ASIC, or it can be an independent semiconductor chip. In addition to the core used to execute software instructions for calculation or processing in the processor, it can also further include necessary hardware accelerators, such as field programmable gate arrays (FPGA), PLDs (programmable logic devices), or logic circuits that implement dedicated logic operations.

[0243] When the above modules or units are implemented in hardware, the hardware can be any one or any combination of a CPU, a microprocessor, a digital signal processing (DSP) chip, a microcontroller unit (MCU), an artificial intelligence processor, an ASIC, a SoC, an FPGA, a PLD, a dedicated digital circuit, a hardware accelerator or a non-integrated discrete device, which can run the necessary software or not rely on the software to execute the above method flow.

[0244] Optionally, the present application also provides a chip system, including: at least one processor and an interface, the at least one processor is coupled to a memory through the interface, and when the at least one processor executes a computer program or instruction in the memory, the method in any of the above method embodiments is executed. In one possible implementation, the chip system also includes a memory. Optionally, the chip system can be composed of a chip, or it can include a chip and other discrete devices, which is not specifically limited in the present application.

[0245] Optionally, the present application also provides a computer-readable storage medium. All or part of the processes in the above method embodiments can be completed by a computer program to instruct the relevant hardware, and the program can be stored in the above computer-readable storage medium. When the program is executed, it can include the processes of the above method embodiments. The computer-readable storage medium can be an internal storage unit of the electronic device of any of the above embodiments, such as a hard disk or memory of the electronic device. The above computer-readable storage medium can also be an external storage device of the above electronic device, such as a plug-in hard disk, a smart memory card (smart media card, SMC), a secure digital (secure digital, SD) card, a flash card (flash card), etc. equipped on the above electronic device. Further, the above computer-readable storage medium can also include both the internal storage unit of the above electronic device and an external storage device. The above computer-readable storage medium is used to store the above computer program and other programs and data required by the above electronic device. The above computer-readable storage medium can also be used to temporarily store data that has been output or is to be output.

[0246] Optionally, the present application also provides a computer program product. All or part of the processes in the above method embodiments can be completed by a computer program to instruct related hardware, and the program can be stored in the above computer program product. When the program is executed, it can include the processes of the above method embodiments.

[0247] Optionally, the present application also provides a computer program (product). All or part of the processes in the above method embodiments can be completed by the computer program or instructions contained in the computer program (product) to instruct related hardware (such as a computer, a processor, device 101 or device 102, etc.). The computer program or instructions can be stored in the above computer-readable storage medium or in the above computer program product.

[0248] Optionally, the present application further provides a communication system, including: the device 101 and the device 102 in the above embodiment. Optionally, the communication system further includes the device 103 in the above embodiment.

[0249] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0250] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0251] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0252] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0253] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A short-distance communication method, characterized in that: The method comprises: Obtaining a first digital sequence based on the information to be sent, where the first digital sequence indicates N signals, where N is an integer greater than 1; N frames of first images are continuously displayed on the screen of the first device, and the N frames of first images respectively correspond to N consecutive frames of second images. The N frames of second images are images displayed on the screen of the first device when the screen communication function of the first device is not turned on. The user's visual perception result of the N frames of first images is the same as the user's visual perception result of the N frames of second images. The change pattern of color information of the N frames of first images is related to the change pattern of the N signals. The color information of the i-th frame of the first image indicates the color accumulated value of the pixel points in the i-th frame of the first image, and i is an integer greater than 1 and less than or equal to N.

2. The method according to claim 1, characterized in that: The visual perception results of the user on the N frames of the first image are the same as the visual perception results of the user on the N frames of the second image, including: The screen refresh rate of the first device is greater than or equal to a first threshold; An absolute value of a difference between a brightness of a first pixel point in the first image of the i-th frame and a brightness of the first pixel point in the second image of the i-th frame is less than or equal to a second threshold, and the first pixel point is any pixel point on the screen of the first device; The absolute value of the difference between the first color information and the second color information is less than or equal to a third threshold, the first color information is the color information of the first pixel in M ​​consecutive first images in the N frames, and the second color information is the color information of the first pixel in M ​​second images corresponding to the M first images, where M is an integer greater than 1 and less than or equal to N.

3. The method according to claim 1 or 2, characterized in that: The obtaining of a first digital sequence based on the information to be sent includes: The information to be sent is modulated at a first bandwidth and a first frequency to obtain the first digital sequence.

4. The method according to claim 3, characterized in that: The changing rule of the color information of the N frames of the first image is related to the changing rule of the N signals, including: Within the first bandwidth, the change rule of the color information of the N frames of the first image is correlated with the change rule of the N signals in the frequency domain, or the change rule of the color information of the N frames of the first image is correlated with the change rule of the N signals in the time domain.

5. The method according to claim 3 or 4, characterized in that: The first frequency is less than or equal to half of a screen refresh rate of the first device.

6. The method according to any one of claims 3 to 5, characterized in that: The method further comprises: R frames of first images are continuously displayed on the screen of the first device, the R frames of first images respectively correspond to continuous R frames of second images, the R frames of second images are images displayed on the screen of the first device when the screen communication function of the first device is not turned on, a visual perception result of the user for the R frames of first images is the same as a visual perception result of the user for the R frames of second images, a change rule of color information of the R frames of first images is related to a change rule of R signals, the color information of the j-th frame of first image indicates the color accumulation value of the pixel points in the j-th frame of first image, the R signals are signals indicated by a synchronization sequence, R is an integer greater than 1, j is an integer greater than 1 and less than or equal to R, and a time period during which the R frames of first images are displayed on the screen of the first device is different from a time period during which the N frames of first images are displayed on the screen of the first device.

7. The method according to claim 6, characterized in that The method further comprises: The synchronization sequence is acquired, where the synchronization sequence is modulated on a second frequency, where the second frequency is different from the first frequency.

8. The method according to any one of claims 1 to 7, characterized in that The continuously displaying N frames of the first image on the screen of the first device includes: fusing the N signals with the N frames of the second image respectively, and continuously displaying the N frames of the first image on the screen of the first device.

9. The method according to any one of claims 1 to 8, characterized in that Each frame of the first image includes P areas, and the positions and sizes of the P areas included in any two frames of the first image are the same. The first digital sequence also indicates (P-1)*N signals. The first digital sequence includes P segment sequences, and each segment sequence indicates N continuous signals among the P*N signals. The P areas correspond to the P segment sequences respectively. The change law of the N frames of color information in each area is related to the change law of the N continuous signals corresponding to the area, and P is an integer greater than 1.

10. The method according to any one of claims 1 to 9, characterized in that The variation rule of the brightness information of the N frames of the first image is related to the variation rule of the N signals.

11. The method according to claim 10, characterized in that The brightness information of the i-th frame of the first image indicates the brightness accumulation value of the pixel points in the i-th frame of the first image.

12. The method according to claim 10 or 11, characterized in that: The variation rule of the brightness information of the N frames of the first image is related to the variation rule of the N signals, including: Within the first bandwidth, the changing law of the brightness information of the N frames of the first image is correlated with the changing law of the N signals in the frequency domain, or the changing law of the brightness information of the N frames of the first image is correlated with the changing law of the N signals in the time domain; the first bandwidth is the modulation bandwidth of the first digital sequence.

13. The method according to any one of claims 10 to 12, characterized in that: Each frame of the first image includes P areas, and the positions and sizes of the P areas included in any two frames of the first image are the same. The first digital sequence also indicates (P-1)*N signals. The first digital sequence includes P segment sequences, and each segment sequence indicates N continuous signals among the P*N signals. The P areas correspond to the P segment sequences respectively. The change law of the N frames of brightness information in each area is related to the change law of the N continuous signals corresponding to the area, and P is an integer greater than 1.

14. The method according to any one of claims 1 to 13, characterized in that The method further comprises: Accessing the first network; Acquire a first shooting frame rate, where the first shooting frame rate is the lowest shooting frame rate among the shooting frame rates supported by the device with a camera function in the first network; The screen refresh rate of the first device is set according to the first shooting frame rate.

15. The method according to any one of claims 1 to 14, characterized in that The method further comprises: First indication information is received, where the first indication information indicates to enable the screen communication function.

16. An electronic device, characterized in that: The electronic device comprises: a processing module and a display module; wherein The processing module is used to obtain a first digital sequence based on the information to be sent, where the first digital sequence indicates N signals, where N is an integer greater than 1; The display module is used to continuously display N frames of first images on the screen of the electronic device, wherein the N frames of first images respectively correspond to N consecutive frames of second images, and the N frames of second images are images displayed on the screen of the electronic device when the screen communication function of the electronic device is not turned on. The user's visual perception result of the N frames of first images is the same as the user's visual perception result of the N frames of second images. The change pattern of color information of the N frames of first images is related to the change pattern of the N signals. The color information of the i-th frame of the first image indicates the color accumulated value of the pixel points in the i-th frame of the first image, and i is an integer greater than 1 and less than or equal to N.

17. The electronic device according to claim 16, characterized in that: The visual perception results of the user on the N frames of the first image are the same as the visual perception results of the user on the N frames of the second image, including: The screen refresh rate of the electronic device is greater than or equal to a first threshold; An absolute value of a difference between a brightness of a first pixel point in the first image of the i-th frame and a brightness of the first pixel point in the second image of the i-th frame is less than or equal to a second threshold, and the first pixel point is any pixel point on the screen of the electronic device; The absolute value of the difference between the first color information and the second color information is less than or equal to a third threshold, the first color information is the color information of the first pixel in M ​​consecutive first images in the N frames, and the second color information is the color information of the first pixel in M ​​second images corresponding to the M first images, where M is an integer greater than 1 and less than or equal to N.

18. The electronic device according to claim 16 or 17, characterized in that: The processing module is specifically configured to modulate the information to be sent at a first bandwidth and a first frequency to obtain the first digital sequence.

19. The electronic device according to claim 18, characterized in that: The changing rule of the color information of the N frames of the first image is related to the changing rule of the N signals, including: Within the first bandwidth, the change rule of the color information of the N frames of the first image is correlated with the change rule of the N signals in the frequency domain, or the change rule of the color information of the N frames of the first image is correlated with the change rule of the N signals in the time domain.

20. The electronic device according to claim 18 or 19, characterized in that: The first frequency is less than or equal to half of a screen refresh rate of the electronic device.

21. The electronic device according to any one of claims 18 to 20, characterized in that: The display module is further used to continuously display R frame first images on the screen of the electronic device, the R frame first images respectively corresponding to continuous R frame second images, the R frame second images are images displayed on the screen of the electronic device when the screen communication function of the electronic device is not turned on, the user's visual perception result of the R frame first images is the same as the user's visual perception result of the R frame second images, the change law of the color information of the R frame first images is related to the change law of R signals, the color information of the j-th frame first image indicates the color accumulated value of the pixel points in the j-th frame first image, the R signals are signals indicated by synchronization sequences, R is an integer greater than 1, j is an integer greater than 1 and less than or equal to R, and the time period for which the R frame first images are displayed on the screen of the electronic device is different from the time period for which the N-frame first images are displayed on the screen of the electronic device.

22. The electronic device according to claim 21, characterized in that: The processing module is further used to obtain the synchronization sequence, where the synchronization sequence is modulated on a second frequency, and the second frequency is different from the first frequency.

23. The electronic device according to any one of claims 16 to 22, characterized in that: The display module is specifically used to fuse the N signals with the N frames of second images respectively, and continuously display the N frames of first images on the screen of the electronic device.

24. The electronic device according to any one of claims 16 to 23, characterized in that: Each frame of the first image includes P areas, and the positions and sizes of the P areas included in any two frames of the first image are the same. The first digital sequence also indicates (P-1)*N signals. The first digital sequence includes P segment sequences, and each segment sequence indicates N continuous signals among the P*N signals. The P areas correspond to the P segment sequences respectively. The change law of the N frames of color information in each area is related to the change law of the N continuous signals corresponding to the area, and P is an integer greater than 1.

25. The electronic device according to any one of claims 16 to 24, characterized in that: The variation rule of the brightness information of the N frames of the first image is related to the variation rule of the N signals.

26. The electronic device according to claim 25, characterized in that: The brightness information of the i-th frame of the first image indicates the brightness accumulation value of the pixel points in the i-th frame of the first image.

27. The electronic device according to claim 25 or 26, characterized in that: The changing law of the brightness information of the N frames of the first image is related to the changing law of the N signals, including: within a first bandwidth, the changing law of the brightness information of the N frames of the first image is related to the changing law of the N signals in the frequency domain, or the changing law of the brightness information of the N frames of the first image is related to the changing law of the N signals in the time domain; the first bandwidth is the modulation bandwidth of the first digital sequence.

28. The electronic device according to any one of claims 25 to 27, characterized in that: Each frame of the first image includes P areas, and the positions and sizes of the P areas included in any two frames of the first image are the same. The first digital sequence also indicates (P-1)*N signals. The first digital sequence includes P segment sequences, and each segment sequence indicates N continuous signals among the P*N signals. The P areas correspond to the P segment sequences respectively. The change law of the N frames of brightness information in each area is related to the change law of the N continuous signals corresponding to the area, and P is an integer greater than 1.

29. The electronic device according to any one of claims 16 to 28, characterized in that: The electronic device further comprises: an interface module; The interface module is used to access the first network; The processing module is further used to obtain a first shooting frame rate, where the first shooting frame rate is the lowest shooting frame rate among the shooting frame rates supported by the device with a camera function in the first network; The processing module is further used to set the screen refresh rate of the electronic device according to the first shooting frame rate.

30. The electronic device according to any one of claims 16 to 29, characterized in that: The electronic device further comprises: an interface module; The interface module is used to receive first indication information, where the first indication information indicates to enable the screen communication function.

31. An electronic device, characterized in that: include: A processor, the processor is coupled to a memory, the memory is used to store programs or instructions, when the program or instructions are executed by the processor, the electronic device executes the method as claimed in any one of claims 1 to 15.

32. A chip, characterized in that: include: A processor, wherein the processor is coupled to a memory, wherein the memory is used to store programs or instructions, and when the programs or instructions are executed by the processor, the chip executes the method as claimed in any one of claims 1 to 15.

33. A computer-readable storage medium having a computer program or instruction stored thereon, characterized in that: When the computer program or instructions are executed, the computer is caused to perform the method according to any one of claims 1 to 15.

34. A computer program product, comprising computer program code, characterized in that: When the computer program code is executed on a computer, the computer is caused to implement the method according to any one of claims 1 to 15.

35. A communication system, characterized in that: The communication system includes: an electronic device as described in any one of claims 16 to 30, and a second device, wherein the second device is used to scan N frames of first images displayed on the screen of the electronic device through a camera function, and demodulate to obtain information to be received.

Images