Short-range communication method, and electronic device and communication system

Abstract

A short-range communication method, and an electronic device and a communication system, which relate to the technical field of communications. The method is applied to a first device provided with a screen, and the method comprises: on the basis of information to be sent, a first device obtaining a digital sequence that can indicate N signals, and displaying N first image frames on a screen, wherein the N first image frames respectively correspond to N second image frames, the N second image frames are images displayed on the screen of the first device when a screen communication function is disabled, a user has the same visual perception result for the N first image frames and the N second image frames, and a changing rule of color information of the N first image frames is related to a changing rule of the N signals. The method can enable the user of the first device not to perceive the operations, and enable a second device with a camera function to perform demodulation by means of scanning the N first image frames, so as to obtain the information to be sent of the first device. The method involves simple operations and provides a good directivity, thereby improving the user experience.

Description

Short-range communication method, electronic device, and communication system

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on November 9, 2023, with application number 202311497923.8 and invention name “Short-range communication method, electronic device and communication system”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of communication technology, and in particular to short-distance communication methods, electronic devices, and communication systems. Background Art

[0003] With the development of communication technology, short-range communication technologies, such as Bluetooth (BT) and wireless fidelity (WiFi), have become widely used in daily life. Typically, before devices can communicate over short distances, they need to establish a connection. This process, such as requiring users to search for the device and enter a password, is complex and can result in a poor user experience.

[0004] Summary of the Invention

[0005] The present application provides a short-range communication method, electronic device, and communication system, which can solve the problem of complex user operations in short-range communication and improve user experience.

[0006] To achieve the above objectives, this application adopts the following technical solutions:

[0007] In a first aspect, a short-range communication method is provided, which can be performed by a first device equipped with a screen. The first device here can refer to the first device itself or a processor, module, logical node, chip, or chip system in the first device that implements the method.

[0008] The method includes: obtaining a first digital sequence for indicating N signals based on information to be sent; and continuously displaying N frames of first images on the screen of the first device. The N frames of first images respectively correspond to N consecutive frames of second images, and the N frames of second images are images displayed on the screen of the first device when the screen communication function of the first device is not enabled. A user's visual perception of the N frames of first images is the same as that of the N frames of second images. The variation pattern of color information of the N frames of first images is related to the variation pattern of the N signals. The color information of the i-th frame of the first image indicates the color accumulation value of pixels in the i-th frame of the first image, where N is an integer greater than 1, and i is an integer greater than 1 and less than or equal to N.

[0009] Based on the method provided in the first aspect above, the first device can modulate the information to be sent onto the N frames of the first image displayed by the first device. In this way, a device with a video or camera function, such as the second device, can scan the N frames of the first image and demodulate to recover the information to be sent, thereby realizing "communication" between devices. In the above-mentioned "communication" process, the device to be "communicated" can be selected by adjusting the orientation of the device 102. The user does not need to manually search for the device. The operation is simple and has good directionality, which can enhance the user experience. In addition, since the user's visual perception results of the N frames of the first image are the same as the user's visual perception results of the N frames of the second image, the information to be sent integrated into the first image is "transparent" to the user, and the user cannot perceive it, which does not affect the user's use of the first device.

[0010] In one possible implementation, the user's visual perception results of N frames of the first image are the same as the user's visual perception results of N frames of the second image, including: the screen refresh rate of the first device is greater than or equal to the first threshold; the absolute value of the difference between the brightness of the first pixel point in the i-th frame of the first image and the brightness of the first pixel point in the i-th frame of the second image is less than or equal to the second threshold, and the first pixel point is any pixel point on the screen of the first device; the absolute value of the difference between the first color information and the second color information is less than or equal to the third threshold, the first color information is the color information of the first pixel point in M ​​consecutive frames of the first image in N frames, and the second color information is the color information of the first pixel point in M ​​frames of the second image corresponding to the M frames of the first image, where M is an integer greater than 1 and less than or equal to N.

[0011] Understandably, when two different colors flicker alternately but with minimal brightness change and a flickering frequency greater than a certain value, the human eye perceives the fused colors and is unable to detect the color flicker. Therefore, based on the possible implementation described above, the user cannot distinguish between the first image and the second image. In other words, the information of the N signals fused into the N frames of the first image is "transparent" to the user and does not affect the content originally displayed on the screen.

[0012] In a possible implementation, obtaining a first digital sequence based on information to be sent includes: modulating the information to be sent at a first bandwidth and a first frequency to obtain the first digital sequence.

[0013] Based on the above possible implementations, the information to be transmitted can be modulated to obtain a first digital sequence. For example, the information to be transmitted can be digitally baseband modulated to obtain a first bit sequence, and the first bit sequence can be phase modulated at a first bandwidth and a first frequency to obtain a first digital sequence.

[0014] In one possible implementation, a change pattern of color information of N frames of first images is related to a change pattern of N signals, including: within a first bandwidth, a change pattern of color information of the N frames of first images is related to a change pattern of the N signals in the frequency domain, or a change pattern of color information of the N frames of first images is related to a change pattern of the N signals in the time domain.

[0015] Based on the above possible implementation methods, the information of N signals can be integrated into the color information of N frames of first images, so that a device with a camera function can scan these first images and demodulate according to the changes in color information to restore the information to be sent.

[0016] In one possible implementation, the first frequency is less than or equal to half of a screen refresh rate of the first device.

[0017] It is understandable that when performing phase modulation, the modulation frequency is generally not greater than half of the current screen refresh rate. Therefore, the first frequency is less than or equal to half of the screen refresh rate of the first device. Furthermore, the higher the modulation frequency, the more "transparent" the information of the N signals fused in the N frames of the first image is to the user. Therefore, if the first frequency is equal to half of the screen refresh rate of the first device, the user's perception of the N signals fused in the N frames of the first image can be minimized. If the first frequency is less than the screen refresh rate of the first device, the computing power of the first device can be saved, thereby reducing power consumption.

[0018] In one possible implementation, the method further includes: continuously displaying R-frame first images on the screen of the first device, the R-frame first images corresponding to continuous R-frame second images respectively, the R-frame second images being images displayed on the screen of the first device when the screen communication function of the first device is not turned on, the user's visual perception result of the R-frame first image is the same as the user's visual perception result of the R-frame second image, the change pattern of the color information of the R-frame first image is related to the change pattern of the R signals, the R signals are signals indicated by synchronization sequences, R is an integer greater than 1, the color information of the j-th frame first image indicates the color cumulative value of the pixel points in the j-th frame first image, j is an integer greater than 1 and less than or equal to R, and the time period during which the R-frame first image is displayed on the screen of the first device is different from the time period during which the N-frame first image is displayed on the screen of the first device.

[0019] Based on the above possible implementation methods, the first device can modulate the synchronization sequence onto the R frame first image displayed by the first device, so that the device with a camera function can determine the N frame first image in the scanned image based on the R frame first image.

[0020] In a possible implementation, the method further includes: acquiring a synchronization sequence, where the synchronization sequence is modulated on a second frequency, and the second frequency is different from the first frequency.

[0021] Based on the above possible implementation manner, the device with a camera function can determine R frames of first images according to the second frequency, and then determine N frames of first images in the scanned image according to the R frames of first images.

[0022] In a possible implementation, the method further includes: continuously displaying N frames of first images on the screen of the first device, including: fusing the N signals with the N frames of second images respectively, and continuously displaying the N frames of first images on the screen of the first device.

[0023] Based on the above possible implementation manner, the first device may fuse N signals with N frames of second images respectively, so as to modulate the information to be sent onto N frames of first images.

[0024] In one possible implementation, each frame of the first image includes P areas, and the positions and sizes of the P areas included in any two frames of the first image are the same. The first digital sequence also indicates (P-1)*N signals. The first digital sequence includes P segment sequences, each segment sequence indicates N consecutive signals among the P*N signals, and the P areas correspond to the P segment sequences respectively. The change pattern of the N frames of color information in each area is related to the change pattern of the N consecutive signals corresponding to the area, and P is an integer greater than 1.

[0025] Based on the above possible implementation methods, the first image can be divided into areas, and the N frames of color information in each area can be fused with different signals, so that a device with a camera function can scan a frame of the first image and demodulate multiple signals, which can shorten the time it takes for the device to scan the first image.

[0026] In a possible implementation, a variation pattern of brightness information of N frames of first images is related to a variation pattern of N signals.

[0027] Based on the foregoing possible implementation manner, the first device may further fuse information of the N signals into brightness information of N frames of first images.

[0028] In a possible implementation, the brightness information of the i-th frame of the first image indicates the accumulated brightness value of the pixels in the i-th frame of the first image.

[0029] Based on the above possible implementation manner, the brightness information of the first image of the i-th frame can be determined.

[0030] In one possible implementation, a variation pattern of the brightness information of the N frames of first images is related to a variation pattern of the N signals, including: within a first bandwidth, a variation pattern of the brightness information of the N frames of first images is correlated with a variation pattern of the N signals in the frequency domain, or a variation pattern of the brightness information of the N frames of first images is correlated with a variation pattern of the N signals in the frequency domain; the first bandwidth is a modulation bandwidth of the first digital sequence.

[0031] Based on the possible implementation manner described above, a device with a camera function can scan N frames of first images and demodulate them according to changes in brightness information to restore information to be sent.

[0032] In one possible implementation, each frame of the first image includes P areas, and the positions and sizes of the P areas included in any two frames of the first image are the same. The first digital sequence also indicates (P-1)*N signals. The first digital sequence includes P segment sequences, each segment sequence indicates N continuous signals among the P*N signals, and the P areas correspond to the P segment sequences respectively. The change pattern of the N frames of brightness information in each area is related to the change pattern of the N continuous signals corresponding to the area, and P is an integer greater than 1.

[0033] Based on the above possible implementation methods, the first image can be divided into areas, and the N frames of brightness information in each area can be fused with different signals, so that a device with a camera function can scan a frame of the first image and demodulate multiple signals, which can shorten the time it takes for the device to scan the first image.

[0034] In one possible implementation, the method also includes: accessing a first network; obtaining a first shooting frame rate, which is the lowest shooting frame rate among the shooting frame rates supported by devices with a camera function in the first network; and setting a screen refresh rate of the first device according to the first shooting frame rate.

[0035] Based on the above possible implementation methods, the first device can set the refresh rate according to the lowest shooting frame rate among the shooting frame rates supported by the devices with camera functions in the first network, so that when the devices with camera functions in the first network scan N frames of first images, the shooting frame rate used is greater than or equal to the screen refresh rate of the first device, thereby realizing the scanning of N frames of first images.

[0036] In a possible implementation, the method further includes: receiving first indication information, where the first indication information indicates to enable the screen communication function.

[0037] Based on the above possible implementation manner, the first device can enable the screen communication function according to the instruction.

[0038] In a second aspect, a short-range communication method is provided, which can be performed by a second device with a camera function. The second device here can refer to the second device itself, or to a processor, module, logical node, chip, or chip system in the second device that implements the method. In this application, the camera function can be replaced with the photo function.

[0039] The method includes: scanning N frames of first images displayed on the screen of the first device through a camera function, and demodulating to obtain information to be received, where N is an integer greater than 1.

[0040] Based on the method provided in the second aspect above, the second device can scan N frames of the first image displayed on the screen of the first device and demodulate to obtain the information that the first device wants to "send" to the second device, thereby realizing "communication" between the first device and the second device.

[0041] In one possible implementation, the method also includes: accessing a first network; obtaining a first shooting frame rate, which is the lowest shooting frame rate among the shooting frame rates supported by devices with a camera function in the first network; and setting the shooting frame rate of the camera function according to the first shooting frame rate.

[0042] Based on the above possible implementation methods, the second device can set the shooting frame rate of the camera function according to the lowest shooting frame rate among the shooting frame rates supported by the devices with camera functions in the first network to realize scanning of N frames of first images.

[0043] In a possible implementation, the method further includes: sending first indication information, where the first indication information indicates to enable the screen communication function.

[0044] Based on the above possible implementation methods, the device with a screen (such as the first device) can be instructed to enable the screen communication function.

[0045] In a possible implementation, the method further includes: sending second indication information, where the second indication information indicates a shooting frame rate supported by the second device.

[0046] Based on the above possible implementation manner, the shooting frame rate supported by itself can be sent so that the device receiving the second indication information, such as the host in the first network, can determine the first shooting frame rate.

[0047] In a third aspect, an electronic device is provided for implementing the method provided in the first aspect. The electronic device may be the first device in the first aspect. The electronic device includes modules, units, or means corresponding to implementing the above method. The modules, units, or means may be implemented in hardware, software, or by hardware executing corresponding software implementations. The hardware or software includes one or more modules or units corresponding to the above functions.

[0048] In conjunction with the third aspect, in one possible implementation, the electronic device may include a processing module and a display module. The processing module may be configured to implement the processing functionality described in the first aspect and any possible implementation thereof. The processing module may, for example, be a processor. The display module, also referred to as an interface unit, may be configured to implement the display functionality described in the first aspect and any possible implementation thereof. The display module may, for example, be a display screen.

[0049] In conjunction with the third aspect, in one possible implementation, the electronic device further includes an interface module. This interface module, which may also be referred to as an interface unit, is configured to implement the sending and / or receiving functions described in the first aspect and any possible implementation thereof. The interface module may include an interface circuit, a transceiver, a transceiver, or a communication interface.

[0050] In combination with the third aspect above, in a possible implementation, the interface module includes a sending module and a receiving module, which are respectively used to implement the sending and receiving functions in the first aspect above and any possible implementation thereof.

[0051] In a fourth aspect, an electronic device is provided for implementing the method provided in the second aspect. The electronic device may be the second device in the second aspect. The electronic device includes modules, units, or means corresponding to implementing the method. The modules, units, or means may be implemented in hardware, software, or by hardware executing corresponding software implementations. The hardware or software includes one or more modules or units corresponding to the aforementioned functions.

[0052] In conjunction with the fourth aspect, in one possible implementation, the electronic device may include a processing module. The processing module may be configured to implement the processing functions described in the second aspect and any possible implementation thereof. The processing module may be, for example, a processor.

[0053] In conjunction with the fourth aspect, in one possible implementation, the electronic device may further include an interface module. This interface module, also referred to as an interface unit, is configured to implement the sending and / or receiving functions described in the second aspect and any possible implementation thereof. The interface module may include an interface circuit, a transceiver, a transceiver, or a communication interface.

[0054] In combination with the fourth aspect above, in a possible implementation, the interface module includes a sending module and a receiving module, which are respectively used to implement the sending and receiving functions in the second aspect above and any possible implementation thereof.

[0055] In a fifth aspect, an electronic device is provided, comprising: a processor; the processor is coupled to a memory, and after reading instructions from the memory, executes the method described in any of the above aspects according to the instructions. The electronic device may be the first device described in the first aspect; or the electronic device may be the second device described in the second aspect.

[0056] In conjunction with the fifth aspect above, in one possible implementation, the electronic device further includes a memory for storing program instructions and data. Optionally, the memory is integrated with the processor above; or the memory is independent of the processor.

[0057] In conjunction with the fifth aspect above, in one possible implementation, the electronic device is a chip or a chip system. Optionally, when the electronic device is a chip system, it can be composed of a chip or include a chip and other discrete devices.

[0058] In a sixth aspect, an electronic device is provided, comprising: a processor and an interface circuit; the interface circuit is configured to receive a computer program or instruction and transmit it to the processor; the processor is configured to execute the computer program or instruction, thereby causing the electronic device to perform the method described in any of the above aspects. The electronic device may be the first device described in the first aspect; alternatively, the electronic device may be the second device described in the second aspect.

[0059] In conjunction with the sixth aspect above, in one possible implementation, the electronic device is a chip or a chip system. Optionally, when the electronic device is a chip system, it can be composed of a chip or include a chip and other discrete devices.

[0060] In a seventh aspect, a computer-readable storage medium is provided, wherein instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium is run on the computer, the computer can execute the method described in any one of the above aspects.

[0061] In an eighth aspect, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute the method described in any one of the above aspects.

[0062] In a ninth aspect, a communication system is provided, which includes a first device for executing the method described in the first aspect, and a second device for executing the method described in the second aspect.

[0063] Among them, the technical effects brought about by any possible implementation method in the third to ninth aspects can be referred to the technical effects brought about by any aspect in the first to second aspects or different possible implementation methods in any aspect, and will not be repeated here.

[0064] It is understandable that, provided that the solutions are not contradictory, the solutions in each aspect can be combined. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] FIG1 is a schematic diagram of the communication system architecture provided by this application;

[0066] FIG2 is a schematic diagram of the hardware structure of the electronic device provided in this application;

[0067] FIG3 is a flow chart of a short-distance communication method provided by the present application;

[0068] FIG4A is a schematic diagram 1 of the first digital sequence provided by this application;

[0069] FIG4B is a schematic diagram of the fusion of the signal and the second image provided by the present application;

[0070] FIG5A is a second schematic diagram of the first digital sequence provided by this application;

[0071] FIG5B is a schematic diagram of the change pattern of 120 frames of first images in the time domain provided by the present application;

[0072] FIG5C is a first schematic diagram of the frequency domain variation pattern of the R channel of 120 frames of the first image provided by the present application;

[0073] FIG5D is a schematic diagram of color information and brightness information of 120 frames of second images provided by the present application;

[0074] FIG5E is a schematic diagram of the variation pattern of the R channel of 120 frames of the first image in the time domain provided by this application;

[0075] FIG5F is a second schematic diagram of the frequency domain variation pattern of the R channel of the 120 frames of the first image provided by this application;

[0076] FIG6 is a schematic diagram of an area in a first image provided by this application;

[0077] FIG7 is a schematic diagram of a device provided by the present application accessing a first network;

[0078] FIG8 is a second flow chart of the short-distance communication method provided by this application;

[0079] FIG9 is a first structural diagram of an electronic device provided by the present application;

[0080] FIG10 is a second structural diagram of the electronic device provided in this application. DETAILED DESCRIPTION

[0081] To address the complex user operations associated with short-range communications, this application provides a short-range communication method applicable to a first device and a second device. The first device is equipped with a screen, and the second device has a camera function. In this method, the first device can obtain a first digital sequence indicating N signals based on the information to be transmitted, and continuously display N frames of first images on the screen of the first device. The color information of the N frames of first images varies in a manner related to the variation of the N signals, and the color information of the i-th frame of the N frames of first images indicates the accumulated color values ​​of the pixels in the i-th frame of the first image, where i is an integer greater than 1 and less than or equal to N, and N is an integer greater than 1. The second device can scan the N frames of first images displayed on the screen of the first device using its camera function and demodulate them to obtain the information to be received. In this application, the camera function is primarily used to scan the image displayed on the screen of the first device. Therefore, the camera function can be replaced with other functions that can achieve the aforementioned functions, such as a camera function, without limitation. For ease of description, this application uses the camera function as an example.

[0082] It can be understood that the N frames of the first image displayed on the first device incorporate the information of the N signals corresponding to the information to be sent. The second device scans the N frames of the first image through the camera function and demodulates them to obtain the information to be sent by the first device (i.e., the information to be received by the second device). The above process does not require the participation of the user of the first device, and the user of the second device does not need to search for the first device. Instead, the user adjusts the direction of the second device so that the camera module of the second device is quickly aligned with the screen of the first device and scans the N frames of the first image displayed on the screen of the first device to achieve "communication" between the first device and the second device. Therefore, the above method is simple to operate and has good directionality, which can improve the user experience.

[0083] In some embodiments, N frames of first image correspond to N consecutive frames of second image respectively. Among them, N frames of second image are images displayed on the screen of the first device when the screen communication function of the first device is not turned on, and the user's visual perception result of the N frames of first image is the same as the user's visual perception result of the N frames of second image. In other words, the i-th frame of the first image is the image obtained after the i-th signal is fused into the i-th frame of the second image, but the user cannot distinguish the difference between the first image and the second image, that is, the information of the N signals fused in the N frames of the first image is "transparent" to the user, and does not affect the content originally displayed on the screen. In this way, the user does not perceive the communication between the first device and the second device, and it does not affect the user's use of the first device, which can further improve the user experience.

[0084] The method provided in this application can be used in communication systems for various screen devices and camera devices. The method provided in this application is described below using the communication system 10 shown in Figure 1 as an example. Figure 1 is only a schematic diagram and does not constitute a limitation on the applicable scenarios of the technical solution provided in this application.

[0085] As shown in Figure 1, it is a schematic diagram of the architecture of the communication system 10 provided in this application. In Figure 1, the communication system 10 may include a device 101 (corresponding to the first device in the invention content) and a device 102 (corresponding to the second device in the invention content). Optionally, the communication system 10 also includes a device 103 that can be communicatively connected with the device 101 and the device 102. Among them, the device 101 is configured with a screen to display an image that integrates the information to be sent. The device 102 has a camera function, for example, the device 102 is configured with a camera to scan the image displayed on the screen of the device 101. The device 103 can assist the device 101 and the device 102 to achieve communication between the two. For example, the device 103 can assist the device 101 in setting the screen refresh rate and assist the device 102 in setting the shooting frame rate, so that the shooting frame rate of the device 102 is greater than or equal to the screen refresh rate of the device 101, to ensure that the device 102 can capture the image displayed on the device 101.

[0086] In Figure 1, device 103 and device 101 can communicate via wired or wireless communication, and device 103 and device 102 can communicate via wired or wireless communication. In this application, wireless communication includes but is not limited to Bluetooth communication, cellular communication, Star Flash standard communication, or wireless fidelity (WiFi) communication. Among them, cellular communication is, for example, fourth generation (4G) communication, fifth generation (5G) communication, or future evolved communication (such as: sixth generation (6G) communication).

[0087] In some embodiments, device 101 and device 102 may be in the same network. For example, device 101 and device 102 may be connected to the same WiFi network (e.g., a whole-home smart network) or the same local area network (e.g., a network deployed in a smart campus). For another example, device 101 and device 102 may both be connected to device 103.

[0088] Optionally, device 101 or device 102 may also have the function of device 103.

[0089] Optionally, the device 101 may have a camera function.

[0090] Optionally, device 102 may be configured with a screen.

[0091] Optionally, an operating system, such as the Harmony system, is deployed on device 101 and device 102. Device 103 may also deploy the system. In some embodiments, the operating system may also be an Android system or other operating systems.

[0092] It is understandable that the present application does not limit the product form of devices 101 to 103, and devices 101, 102 or 103 can be handheld devices, vehicle-mounted devices, wearable devices or computing devices, etc. For example, device 101 can be a mobile phone, a tablet computer, a laptop computer, a PDA, a mobile internet device (MID), a satellite terminal, a desktop computer, a smart screen, an intelligent robot, a terminal in industrial control, a terminal in unmanned driving, a terminal in telemedicine, a terminal in a smart grid, a terminal in transportation safety, a terminal in a smart city, a terminal in a smart home, a vehicle-mounted terminal or a smart watch, etc. Device 102 can be a mobile phone, a tablet computer, a laptop computer, a PDA, an MID, a satellite terminal, a camera device, an intelligent robot, a terminal in industrial control, a terminal in unmanned driving, a terminal in telemedicine, a terminal in a smart grid, a terminal in transportation safety, a terminal in a smart city, a terminal in a smart home, a vehicle-mounted terminal or a smart watch, etc. Device 103 can be a whole-house smart host, router, central control screen, mobile phone, tablet computer, laptop computer, desktop computer, switch, modem or smart robot, etc.

[0093] The communication system 10 shown in FIG1 is for illustrative purposes only and is not intended to limit the technical solutions of this application. Those skilled in the art will appreciate that, in a specific implementation, the communication system 10 may further include other devices, for example, a device with a screen other than device 101 and / or a camera device other than device 102.

[0094] Optionally, each device in FIG. 1 of the present application (eg, device 101, device 102, or device 103) may also be referred to as an electronic device, which may be a general-purpose device or a dedicated device, and the present application does not impose any specific limitation on this.

[0095] Optionally, the relevant functions of each device in FIG. 1 of the present application (e.g., device 101, device 102, or device 103) may be implemented by a single device, or may be implemented jointly by multiple devices, or may be implemented by one or more functional modules within a single device, and this application does not impose any specific limitations on this. It is understood that the above functions may be network elements in a hardware device, software functions running on dedicated hardware, or a combination of hardware and software, or virtualized functions instantiated on a platform (e.g., a cloud platform).

[0096] In a specific implementation, each device in FIG1 of the present application (such as device 101, device 102 or device 103) can adopt the composition structure shown in FIG2, or include the components shown in FIG2. FIG2 shows a schematic diagram of the hardware structure of an electronic device applicable to the present application. The electronic device 200 includes a processor 210 and a memory 221. If the electronic device 200 is the device 101 in FIG1, the electronic device 200 also includes a display screen 290; if the electronic device 200 is the device 102 in FIG1, the electronic device 200 also includes a camera 291. Optionally, the electronic device 200 also includes at least one of the following: an external memory interface 220, a universal serial bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a sensor module 280, an indicator 292, or a subscriber identification module (SIM) card interface 293, etc. A detailed introduction is given below.

[0097] The processor 210 may include one or more processing units. For example, the processor 210 may include one or more of the following: an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, a neural network processing unit (NPU), etc. The different processing units may be independent devices or integrated into one or more processors. The controller may generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution.

[0098] Optionally, processor 210 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 210 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 210. If processor 210 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of processor 210, and thus improves system efficiency.

[0099] In some embodiments, the processor 210 may include one or more interfaces. The interfaces may include one or more of the following interfaces: an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2C) interface, an integrated circuit audio ... 2 S) interface, pulse code modulation (PCM) interface, universal asynchronous receiver / transmitter (UART) interface, mobile industry processor interface (MIPI), general-purpose input / output (GPIO) interface, SIM interface, USB interface, etc.

[0100] The charging management module 240 is configured to receive charging input from a charger, which may be a wireless charger or a wired charger.

[0101] The power management module 241 is used to connect the battery 242, the charging management module 240, and the processor 210. The power management module 241 receives input from the battery 242 and / or the charging management module 240 to provide power to the processor 210, the memory 221, the display 290, the camera 291, and the wireless communication module 260.

[0102] The wireless communication function of the electronic device 200 can be implemented through antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, modulation and demodulation processor and baseband processor. Among them, antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antenna. The mobile communication module 250 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied on the electronic device 200. The wireless communication module 260 can provide solutions for wireless communications including wireless local area networks (WLAN) (such as Wi-Fi networks), Bluetooth, global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc. applied on the electronic device 200.

[0103] Electronic device 200 implements display functionality through a GPU, display screen 290, and an application processor. The GPU is a microprocessor for image processing that connects display screen 290 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 210 may include one or more GPUs that execute program instructions to generate or modify display information.

[0104] Display screen 290 is used to display images, videos, and the like. Display screen 290 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 200 can include one or n display screens 290, where n is a positive integer greater than 1.

[0105] The electronic device 200 can implement a shooting function through an ISP, a camera 291, a video codec, a GPU, a display screen 290, and an application processor.

[0106] The ISP processes data fed back by camera 291. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 291.

[0107] The camera 291 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 200 may include 1 or n cameras 291, where n is a positive integer greater than 1.

[0108] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 200 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0109] The external memory interface 220 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 200. The external memory card communicates with the processor 210 via the external memory interface 220 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0110] The memory 221 can be used to store computer executable program codes, which include instructions. The memory 221 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 200 (such as audio data, a phone book, etc.), etc. In addition, the memory 221 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 210 executes various functional applications and data processing of the electronic device 200 by running instructions stored in the memory 221, and / or instructions stored in a memory provided in the processor.

[0111] The electronic device 200 can implement audio functions such as music playback and recording through the audio module 270 and the application processor. The audio module 270 may include a speaker, a receiver, a microphone, an earphone jack, and the like.

[0112] The sensor module 280 may include one or more sensors for implementing corresponding functions. For example, the sensor module 280 may include at least one of the following: a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0113] The indicator 292 may be an indicator light, which may be used to indicate the charging status, power level change, messages, missed calls, notifications, etc.

[0114] SIM card interface 293 is used to connect a SIM card. A SIM card can be connected to and disconnected from electronic device 200 by inserting or removing it from SIM card interface 293. Electronic device 200 may support one or n SIM card interfaces, where n is a positive integer greater than 1. SIM card interface 293 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Alternatively, some electronic devices equipped with eSIM functionality may not include SIM card interface 293.

[0115] It is understood that the structure illustrated in this application does not constitute a specific limitation on the electronic device 200. In other embodiments of this application, the electronic device 200 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The components shown in the illustrations may be implemented in hardware, software, or a combination of software and hardware.

[0116] The method provided by the present application will be described below with reference to the accompanying drawings. Each device in the following embodiments may include the components shown in FIG2 , which will not be described in detail.

[0117] It is understood that in this application, " / " can indicate that the objects associated with each other are in an "or" relationship, for example, A / B can mean A or B; "and / or" can be used to describe that there are three relationships between the associated objects, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. In addition, expressions similar to "at least one of A, B and C" or "at least one of A, B or C" are usually used to indicate any of the following: A exists alone; B exists alone; C exists alone; A and B exist at the same time; A and C exist at the same time; B and C exist at the same time; A, B and C exist at the same time. The above uses A, B and C as an example to illustrate the optional items of the item. When there are more elements in the expression, the meaning of the expression can be obtained according to the above rules.

[0118] In order to facilitate the description of the technical solutions of the present application, in the present application, words such as "first" and "second" may be used to distinguish between technical features with the same or similar functions. The words such as "first" and "second" do not limit the quantity and execution order, and the words such as "first" and "second" do not necessarily limit them to be different. In the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "for example" should not be interpreted as being more preferred or more advantageous than other embodiments or design. The use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete way for easy understanding.

[0119] It is understood that the "embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, the various embodiments in the entire specification do not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It is understood that in the various embodiments of the present application, the size of the sequence number of each process does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the present application.

[0120] It can be understood that in this application, "when...", "in the case of...", "if" and "if" all mean that corresponding processing will be taken under certain objective circumstances, and do not limit the time, nor do they require judgment actions when implementing them, nor do they mean that there are other limitations.

[0121] The term "simultaneously" in this application may be understood as at the same time point, within a period of time, or within the same cycle.

[0122] In this application, "a plurality of" can be understood as two or more than two. For example, a plurality of signals can be understood as two or more than two signals.

[0123] In this application, "greater than or equal to" can be replaced by "greater than" or "equal to"; "less than or equal to" can be replaced by "less than" or "equal to". For example, "A is greater than or equal to B" can be replaced by "A is greater than B" or "A is equal to B"; "A is less than or equal to B" can be replaced by "A is less than B" or "A is equal to B".

[0124] It is understood that some optional features in this application may, in certain scenarios, be implemented independently of other features, such as the solution on which they are currently based, to solve corresponding technical problems and achieve corresponding effects. They may also be combined with other features in certain scenarios as needed. Accordingly, the devices provided in this application may also implement these features or functions accordingly, which will not be described in detail here.

[0125] It is understandable that the same step or steps or technical features with the same function in different embodiments of the present application can be referenced to each other.

[0126] The following uses the device 101 and the device 102 in Figure 1 as an example of the execution subject of the interaction diagram to illustrate the short-range communication method provided by this application, but this application does not limit the execution subject of the interaction diagram. For example, the device (such as device 101 or device 102) in the method provided in the following embodiments of this application can also be a chip, chip system, or processor that supports the device to implement the method, or can also be a logical node, logic module or software that can implement all or part of the device functions.

[0127] It is understood that in the present application, device 101 and / or device 102 may perform some or all of the steps in the present application. These steps are merely examples, and the present application may also perform other steps or variations of various steps. In addition, the steps may be performed in a different order than presented in the present application, and it is possible that not all of the steps in the present application need to be performed.

[0128] As shown in FIG3 , a short-distance communication method provided by the present application may include the following steps:

[0129] S301: The device 101 turns on the screen communication function.

[0130] In this application, the screen communication function can integrate the information to be sent into multiple frames of images displayed on the screen, so that a device with a camera function (such as device 102) can recover the information to be sent by scanning and demodulating these images, thereby "sending" the information to be sent to the device with a camera function. In this application, "scanning" can be replaced by "shooting", "recording", etc. without limitation.

[0131] In one possible implementation, the device 101 may enable the screen communication function in response to a user operation. For example, the user triggers the device 101 to enable the screen communication function by pressing a button, clicking, performing a gesture, or performing a voice control operation.

[0132] In another possible implementation, device 101 turns on the screen communication function according to the received instruction. For example, device 102 or device 103 sends a first instruction message to device 101. The first instruction message indicates to turn on the screen communication function. After receiving the first instruction message, device 101 turns on the screen communication function. It can be understood that if device 102 and device 101 are in the same network, device 102 can broadcast the first instruction message to the devices in the network; or, if device 102 and device 101 access the network through device 103, device 102 can forward the first instruction message to device 101 through device 103.

[0133] It is understood that step S301 is optional. For example, if the screen communication function is enabled when the device 101 is shipped from the factory, the device 101 may not execute step S301. For another example, if the user has already enabled the screen communication function of the device 101, the device 101 may not execute step S301.

[0134] S302: The device 101 obtains a first digital sequence based on the information to be sent.

[0135] In this application, the information to be sent is information that device 101 wants to transmit to a device other than device 101 (such as device 102). Exemplarily, the information to be sent includes, but is not limited to, one or more of a password (such as a personal identification number (PIN) code), a QR code, a barcode, information about device 101 (such as the identifier and version of device 101), or a website. The information to be sent can be generated by device 101 (such as a QR code, barcode, or PIN code generated by device 101), locally stored (such as information about device 101), or obtained from another device (such as a PIN code generated by device 103 for device 101 and sent to device 101, or information such as a website obtained from a third-party application server).

[0136] In one possible implementation, the device 101 modulates the information to be sent on a first bandwidth and a first frequency to obtain a first digital sequence. The first digital sequence may indicate N signals, where N is an integer greater than 1. For example, the device 101 may perform digital baseband modulation on the information to be sent to obtain a first bit sequence, and perform phase modulation on the first bit sequence on the first bandwidth and the first frequency to obtain a first digital sequence. The digital baseband modulation may be, for example, non-return to zero (NRZ) modulation, differential code modulation, or return to zero code modulation. The phase modulation may be, for example, binary phase shift keying (BPSK), differential binary phase shift keying (DBPSK), or quadrature phase shift keying (QPSK), etc., without limitation. The first bandwidth is the modulation bandwidth of the first digital sequence, for example, the first bandwidth is [20 Hz, 40 Hz], and the first frequency is the modulation frequency of the first digital sequence, for example, the first frequency is 30 Hz. In addition, in the present application, "signal" may be replaced by "chip", etc., without limitation. The device 101 may also perform amplitude modulation on the first bit sequence to obtain a first digital sequence. The following embodiments of the present application are described using phase modulation as an example.

[0137] For example, taking the first bit sequence as "101," N as 12, and BPSK modulation as an example, the first digital sequence may be as shown in FIG4A . In FIG4A , the signal is represented by a "high level" or a "low level." The first bit sequence includes 3 bits, each of which corresponds to 4 signals, where a bit value corresponds to 4 carrier cycles. For example, "1" may be represented by 4 signals of "high-low-high-low," and "0" may be represented by 4 signals of "low-high-low-high." It should be understood that FIG4A is merely an example of the first digital sequence. In specific applications, the first digital sequence may also be represented by other forms, or the first digital sequence may include more or fewer signals than shown in FIG4A , without limitation.

[0138] It can be understood that when phase modulation is performed, the modulation frequency is usually not greater than half of the current refresh rate of the screen. Therefore, the first frequency is less than or equal to half of the screen refresh rate of device 101. Because the higher the modulation frequency, the more "transparent" the information of the N signals fused in the N frames of the first image is to the user. Therefore, if the first frequency is equal to half of the screen refresh rate of device 101, the user's perception of the N signals fused in the N frames of the first image can be minimized. If the first frequency is less than the screen refresh rate of device 101, the computing power of device 101 can be saved and power consumption can be reduced. In this application, the unit of the screen refresh rate and the shooting frame rate described below (such as the first shooting frame rate) can be the number of frames per second (FPS).

[0139] S303: The device 101 continuously displays N frames of the first image on the screen.

[0140] In the present application, N frames of first image correspond to N consecutive frames of second image respectively. For example, the i-th frame of first image corresponds to the i-th frame of second image, where i is an integer greater than 1 and less than or equal to N. The N-frame second image is the image displayed on the screen of the device 101 when the screen communication function is not turned on. The user's visual perception result of the N-frame first image is the same as the user's visual perception result of the N-frame second image. In other words, for the user, the i-th frame of second image is the same as the i-th frame of first image. In this way, it will not affect the user's use of the device 101.

[0141] It's understandable that when two different colors flicker alternately, but with minimal brightness change and a flickering frequency greater than a certain value, the human eye perceives a blend of colors and is unable to detect the color flicker. Based on this principle, constraints can be designed for the first image so that the user's visual perception of N frames of the first image is the same as the user's visual perception of N frames of the second image.

[0142] In one possible design, the screen refresh rate of device 101 is greater than or equal to a first threshold; the absolute value of the difference between the brightness of the first pixel in the first image of the i-th frame and the brightness of the first pixel in the second image of the i-th frame is less than or equal to a second threshold; and the absolute value of the difference between the first color information and the second color information is less than or equal to a third threshold. The first threshold can prevent the user from perceiving screen flicker. For example, the first threshold is 15 Hz, 16 Hz, or 20 Hz. The first pixel is any pixel on the screen of device 101. The first color information is the color information of the first pixel in M ​​consecutive first images in N frames, and the second color information is the color information of the first pixel in M ​​second images corresponding to the M first images, where M is an integer greater than 1 and less than or equal to N, for example, M is equal to the carrier period of the first digital sequence (e.g., 2 frames). The second and third thresholds can ensure that the user's visual perception of the i-th frame second image is the same as the user's visual perception of the i-th frame first image.

[0143] In addition, in order to enable the device 101 to “send” the information to be sent, N frames of first images may carry information of N signals.

[0144] In one possible design, the variation pattern of the color information of the N frames of first images is related to the variation pattern of N signals. For example, within a first bandwidth, the variation pattern of the color information of the N frames of first images is correlated with the variation pattern of the N signals in the frequency domain, and / or the variation pattern of the color information of the N frames of first images is correlated with the variation pattern of the N signals in the time domain. In some embodiments, the variation pattern of the color information of the N frames of first images maintains the same or similar variation trend as the variation pattern of the N signals in the frequency domain, or the variation pattern of the color information of the N frames of first images is the same as the variation pattern of the N signals in the frequency domain. In some embodiments, the variation pattern of the color information of the N frames of first images is linearly correlated with the variation pattern of the N signals in the time domain, and the variation pattern of the color information of the N frames of first images is in a coefficient relationship with the variation pattern of the N signals in the time domain, and the coefficient can be positive or negative. In this way, the information of the N signals can be fused into the color information of the N frames of first images, so that after device 102 scans these first images and demodulates them, it can recover the information to be transmitted. The color information of the i-th frame of the first image indicates the accumulated color value of the pixels in the i-th frame of the first image or the average color value of the pixels in the i-th frame of the first image. For example, the color information of the i-th frame of the first image is the sum of the color values ​​of all or part of the pixels in the i-th frame of the first image, or the sum of the color values ​​of all or part of the pixels in the i-th frame of the first image divided by the number of pixels in the i-th frame participating in the "sum" operation.

[0145] Optionally, the variation pattern of the brightness information of the N frames of first images is related to the variation pattern of the N signals. Exemplarily, within the first bandwidth, the variation pattern of the brightness information of the N frames of first images is correlated with the variation pattern of the N signals in the frequency domain, and / or, the variation pattern of the brightness information of the N frames of first images is correlated with the variation pattern of the N signals in the time domain. In some embodiments, the variation pattern of the brightness information of the N frames of first images maintains the same or similar variation trend as the variation pattern of the N signals in the frequency domain, or the variation pattern of the brightness information of the N frames of first images is the same as the variation pattern of the N signals in the frequency domain. In some embodiments, the variation pattern of the brightness information of the N frames of first images is linearly correlated with the variation pattern of the N signals in the time domain, and the variation pattern of the brightness information of the N frames of first images is in a coefficient relationship with the variation pattern of the N signals in the time domain, and the coefficient can be a positive or negative number. In this way, in addition to the color information of the N frames of first images, the information of the N signals can also be fused into the brightness information of the N frames of first images. The brightness information of the i-th frame first image indicates the accumulated brightness value of the pixels in the i-th frame first image, or indicates the average brightness value of the pixels in the i-th frame first image.

[0146] As can be seen from the above description, the i-th frame of the first image is essentially obtained by fusing the i-th frame of the second image and the i-th signal. For example, the device 101 can obtain N frames of the second image, fuse the N signals with the N frames of the second image respectively, and continuously display the N frames of the first image on the screen of the device 101. It can be understood that the fusion operation of the signal and the second image can be performed by the CPU of the device 101, or by the GPU of the device 101, or by the CPU and GPU of the device 101. Taking the fusion operation performed by the GPU as an example, in Figure 4B, the CPU of the device 101 obtains the signal and the second image, and inputs the signal and the second image into the GPU so that the GPU fuses the signal and the second image and inputs the fused first image into the display.

[0147] In the following, N and M are equal to 2, where the first signal is "high level", and Indicates that the second signal is "low level", and is used Indicates that the red, green, blue (RGB) values ​​of the second image in the first frame are expressed as Indicates that the RGB value of the second image in the second frame is expressed as Indicates that the RGB value of the first image in the first frame is expressed as Indicates that the RGB value of the first image in the second frame is expressed as Indicates that the LAB value of the second image in the first frame is Indicates that the LAB value of the second image in the second frame is Indicates that the LAB value of the first image in the first frame is Indicates that the LAB value of the first image in the second frame is The constraints of the first image are introduced as an example.

[0148] in, and is a spatial matrix in RGB space, with a total dimension of (H×W×Y). i is 1 or 2, H represents the screen height of device 101, W represents the screen width of device 101, and Y is 3, corresponding to R, G, and B, respectively. H is the actual screen height or the downsampled height. Similarly, W is the actual screen width or the downsampled width. It can be expressed as It can be expressed as in this case, It can also be viewed as a spatial matrix with a total of (H×W×Y) dimensions. It can be expressed as In other words, you can Considered as a communication layer. and This is the spatial matrix for the L*A*B (CIELAB) color space specified by the International Commission on Illumination (CIE) (hereafter referred to as CIELAB space). It has a total of (H×W×Z) dimensions, with Z equal to 3, corresponding to lightness (L), A, and B. A represents the component from green to red in CIELAB space, and B represents the component from blue to yellow in CIELAB space. It should be understood that the meaning of B (representing blue) in RGB space is different from that of B (representing the component from blue to yellow in CIELAB space). It can be expressed as It can be expressed as Wherein, (k, l) is a pixel on the screen of device 101.

[0149] Example 1: Device 101 will Convert from RGB space to CIELAB space and get By changing middle and The value of The change rule of the color information of the N frames of the first image is related to the change rule of the N signals. Exemplarily, the screen refresh rate of the device 101 is greater than or equal to the first threshold, and and The following relationships (1) to (4) are satisfied, so that the user's visual perception results of the N frames of the first image and the user's visual perception results of the N frames of the second image are the same, and the change pattern of the color information of the N frames of the first image is related to the change pattern of the N signals.

[0150] (1) L max represents the second threshold. For example, and

[0151] (2) A max represents the third threshold, and B max represents the third threshold, A max and B max Can be the same or different.

[0152] (3)

[0153] (4) Ensure that the first image corresponding to the "high level" (the first image of the first frame in this example) is different from the first image corresponding to the "low level" (the first image of the second frame in this example) so that the device 102 can recover the information to be sent. For example, Among them, CONS1, CONS2, CONS3, CONS4, CONS5, and CONS6 are constants. CONS1, CONS2, and CONS3 can be the same or different, and CONS4, CONS5, and CONS6 can be the same or different. However, CONS1 and CONS4 are different, CONS2 and CONS5 are different, and CONS3 and CONS6 are different. It can be understood that the color information of the first image of the first frame can be expressed as [CONS1, CONS2, CONS3], and the color information of the first image of the second frame can be expressed as [CONS4, CONS5, CONS6].

[0154] Taking the first digital sequence shown in Figure 5A as an example, the first digital sequence indicates 120 signals, the first frequency is 30Hz, the first bandwidth is 20Hz~40Hz, and the RGB values ​​of the 120 frames of the second image remain unchanged or change slightly. In one case, the change rules of the R channel, G channel and B channel of the 120 frames of the first image in the time domain are respectively related to the change rules of the 120 signals. Specifically, it can be shown in Figure 5B. In another case, within the bandwidth of 20Hz~40Hz, the frequency domain change rule of the R channel of the 120 frames of the first image is related to the change rule of the 120 signals. Specifically, it can be shown in Figure 5C. It can be understood that the frequency domain change rule of the G channel or B channel of the 120 frames of the first image is similar to that of the R channel, and is related to the change rule of the 120 signals, so it will not be elaborated. It should be understood that although the R channel, G channel and B channel all carry brightness information and color information, due to Therefore, it can be understood that the above-mentioned changing rules are the changing rules of color information and have little to do with brightness information.

[0155] Optionally, in Example 1, the N frames of the second image (or the N frames of the first image) are quasi-static images. The above relationships (1) and (2) can be transformed into the following relationship:

[0156] (1.1)

[0157] (2.1) and In this example, M is equal to 2.

[0158] Example 2: Device 101 does not convert from RGB space to CIELAB space, but directly modulates the signal according to the change pattern of the high and low levels of the first digital sequence. For example, change in and / or, and / or, The value of Increase ΔR, Increase ΔG, Increase ΔB) so that the change pattern of the color information and brightness information of the N-frame first image is consistent with the change pattern of the N signals. Among them, ΔR is a positive number, a negative number or zero, ΔG is a positive number, a negative number or zero, ΔB is a positive number, a negative number or zero, and ΔR, ΔG and ΔB are the same or different. It can be understood that in order to make the user's visual perception result of the N-frame first image and the user's visual perception result of the N-frame second image the same, the screen refresh rate of the device 101 is greater than or equal to the first threshold, and |ΔR+ΔG+ΔB|≤T, T is related to the second threshold and the third threshold, for example, T is determined to be 3 based on the second threshold and the third threshold. In addition, the device 101 must ensure that the first image corresponding to the "high level" (the first image of the first frame in this example) is different from the first image corresponding to the "low level" (the first image of the second frame in this example), so that the device 102 can recover the information to be sent. For example, let

[0159] Taking the first digital sequence shown in FIG5A and the color and brightness information of 120 frames of the second image shown in FIG5D as an example, the first digital sequence indicates 120 signals, the first frequency is 30 Hz, the first bandwidth is 20 Hz to 40 Hz, and the cumulative value (or average) of the R channel, the cumulative value (or average) of the G channel, and the cumulative value (or average) of the B channel of the 120 frames of the second image show an upward trend. In one case, the temporal variation pattern of the R channel of the 120 frames of the first image is related to the variation pattern of the 120 signals, as shown in FIG5E . It can be understood that the temporal variation pattern of the G channel or B channel of the 120 frames of the first image is similar to that of the R channel, and is related to the variation pattern of the 120 signals, so this will not be described in detail. In another case, within the 20 Hz to 40 Hz bandwidth, the frequency domain variation pattern of the R channel of the 120 frames of the first image is related to the variation pattern of the 120 signals, as shown in FIG5F . It is understandable that the frequency domain variation patterns of the G channel or B channel of the 120 frames of the first image are similar to those of the R channel, and are all related to the variation patterns of the 120 signals, so this will not be described in detail. In addition, since the R channel, G channel, and B channel all carry brightness information and color information, it can be understood that the above variation patterns are the variation patterns of color information and brightness information.

[0160] Optionally, in Example 2, the N frames of second images (or the N frames of first images) are dynamically changing images, such as when the device 101 is playing a video.

[0161] It can be understood that the above examples 1 and 2 are merely examples of the constraint conditions of the first image. In specific applications, the constraint conditions of the first image may also have other forms, which are not limited.

[0162] Optionally, the device 101 may play N frames of the first image in a loop.

[0163] S304: The device 102 scans the N frames of the first image displayed on the screen of the device 101 through the camera function, and demodulates the first image to obtain the information to be received.

[0164] In one possible implementation, device 102 activates a camera function, scans N frames of the first image displayed on the screen of device 101, obtains V frames of the third image, and demodulates the V frames of the third image to obtain the information to be received. V is an integer greater than 1. V may be the same as or different from N. It will be understood that V is related to the shooting frame rate of device 102 and N. The information to be received is the information to be sent that device 102 has recovered.

[0165] Exemplarily, the device 102 turns on the camera function in response to the user's operation. For example, the user triggers the device 102 to turn on the camera function through operations such as buttons, clicks, gestures, or voice control. The user can also set the parameters of the camera function. For example, the user triggers the device 102 to turn on the camera function according to the parameters corresponding to the communication mode through gestures or voice corresponding to the communication mode. The parameters of the camera function may include the shooting frame rate. Optionally, the parameter also includes at least one of the focal length, sensitivity, or exposure time. Optionally, the focal length can be set to a fixed value D to prevent moiré, where D is the focal length corresponding to slight underfocus or slight overfocus. Taking the positive focus equal to 20 cm as an example, D can be set to less than 20 cm or greater than 20 cm. The exposure time can be much less than 1 / T P , where T P is the sampling interval of the device 102. P is the inverse of the shooting frame rate. Afterwards, the device 102 guides the user (such as guiding the user through text or voice) to point the camera at the screen of the device 101, and scans N frames of the first image to obtain V frames of the third image. For example, prompt information may be displayed on the screen of the device 102, such as one or more items such as the captured picture, the duration of the shooting, whether the shooting can be stopped, or whether the shooting angle is correct. When the scanning time is greater than or equal to the preset time, the device 102 performs digital signal processing and demodulation on the third image obtained by scanning, and recovers the information to be sent. It is understandable that if the device 102 fails to recover the information to be sent, it can guide the user to rescan. The device 102 can also prompt the user for the reason for the failure, such as the scanning time is too short or the jitter is severe.

[0166] It is understandable that after device 102 processes the V frames of third images, it can obtain V signals. Since the variation pattern of the color information of the N frames of first images is related to the variation pattern of the N signals, or the variation pattern of the color information and brightness information of the N frames of first images is related to the variation pattern of the N signals, and since the V frames of third images are obtained by scanning the N frames of first images, the variation pattern of the V signals is related to the variation pattern of the N signals. Therefore, by demodulating the V signals, device 102 can recover the information to be transmitted.

[0167] Among them, the actions of the device 101 or device 102 in the above S301-S304 can be executed by the processor 210 in the electronic device 20 shown in Figure 2 calling the application code stored in the memory 221, and this application does not impose any restrictions on this.

[0168] Based on the method shown in FIG3 , device 101 can modulate the information to be sent onto the N frames of the first image displayed by device 101. For the user, the information to be sent integrated into the first image is "transparent" and is not perceived by the user, which does not affect the user's use of device 101. For device 102, the information to be sent integrated into the first image is not "transparent". The information to be sent can be restored by scanning the N frames of the first image and demodulating it, thereby realizing "communication" between device 101 and device 102. In addition, the directionality of light is good, so the device to be "communicated" can be selected by adjusting the direction of the camera of device 102. The user does not need to manually search for the device. The operation is simple and the directionality is good, which can improve the user experience.

[0169] Optionally, in one possible implementation of the method shown in FIG3 , the first image can be divided into regions (e.g., based on the color gamut distribution of the first image), with different signals fused into each region. In this way, when device 102 scans a frame of the first image, it can demodulate multiple signals, thereby shortening the time it takes for device 102 to scan the first image.

[0170] In one possible design, each first image frame includes P regions, and the P regions included in any two first image frames have the same position and size. The first digital sequence also indicates (P-1)*N signals, meaning that the first digital sequence indicates a total of P*N signals. The first digital sequence includes P segments, each segment indicating N consecutive signals among the P*N signals. The P regions correspond to the P segments, respectively. The variation pattern of the N frames of color information within each region is related to the variation pattern of the N consecutive signals corresponding to that region, and P is an integer greater than 1.

[0171] For example, taking P equal to 3 and N equal to 3, the first digital sequence includes 9 signals, namely signal 1 to signal 9. The correspondence between the regions in the three frames of the first image and signals 1 to signal 9 can be shown in Figure 6. In Figure 6, for the first frame of the first image, region 1 is fused with signal 1, region 2 is fused with signal 4, and region 3 is fused with signal 7. For the second frame of the first image, region 1 is fused with signal 2, region 2 is fused with signal 5, and region 3 is fused with signal 8. For the third frame of the first image, region 1 is fused with signal 3, region 2 is fused with signal 6, and region 3 is fused with signal 9. In other words, the changing pattern of the color information in region 1 over the three frames is related to the changing pattern of signals 1 to signal 3, the changing pattern of the color information in region 2 over the three frames is related to the changing pattern of signals 4 to signal 6, and the changing pattern of the color information in region 3 over the three frames is related to the changing pattern of signals 7 to signal 9.

[0172] Optionally, the variation pattern of the N frames of brightness information within each region is related to the variation pattern of the N continuous signals corresponding to the region. Continuing with the first image shown in FIG6 as an example, the variation pattern of the three frames of brightness information within region 1 is related to the variation pattern of signals 1 to 3, the variation pattern of the three frames of brightness information within region 2 is related to the variation pattern of signals 4 to 6, and the variation pattern of the three frames of brightness information within region 3 is related to the variation pattern of signals 7 to 9.

[0173] Optionally, different regions may have different fusion methods to take into account the characteristics of different regions and improve the user experience. For example, if each frame of the first image includes two regions, region 2 is the video window on the desktop of device 101, and region 1 is the portion of the desktop other than the video window, then region 1 fuses the signal using the method of example 1 above, and region 2 fuses the signal using the method of example 2 above. In this way, the playback speed of the dynamic image can be taken into account, and the user will not feel the video freeze. The modulation depth of the static image can also be taken into account, so that the first image seen by the user is closer to the second image.

[0174] Optionally, in a possible implementation of the method shown in Figure 3, in order to facilitate the device 102 to determine the N-frame first image in the scanned image, the device 101 can integrate the synchronization sequence into the R-frame first image displayed on the screen, so that the device 102 determines the N-frame first image based on the R-frame first image.

[0175] In a possible implementation, the device 101 acquires a synchronization sequence and continuously displays R-frame first images on a screen.

[0176] In the present application, the synchronization sequence may indicate R signals, where R is an integer greater than 1. The synchronization sequence is modulated on a second frequency, which is different from the first frequency, for example, the second frequency is less than the first frequency. The synchronization sequence may be pre-stored in the device 101, or the device 101 modulates the synchronization information to obtain the synchronization sequence. For example, the device 101 uses a carrier frequency f c = 20 Hz, 1-2 carrier cycles of the length of the modulation synchronization information to obtain a synchronization sequence. The process of device 101 modulating the synchronization information to obtain the synchronization sequence is similar to the process of device 101 modulating the information to be transmitted to obtain the first digital sequence. Please refer to the corresponding description in S302 and will not be repeated here.

[0177] In the present application, the R frame first image corresponds to the continuous R frame second image respectively, and the R frame second image is the image displayed on the screen of the device 101 when the screen communication function of the device 101 is not turned on. The user's visual perception result of the R frame first image is the same as the user's visual perception result of the R frame second image. The change pattern of the color information of the R frame first image is related to the change pattern of the R signals. The color information of the j-th frame first image indicates the color accumulation value of the pixel point in the j-th frame first image, and j is an integer greater than 1 and less than or equal to R. The relationship between the R frame first image, the R frame second image and the R signals is similar to the relationship between the N-frame first image, the N-frame second image and the N signals. Please refer to the corresponding description in S303 and will not be repeated here.

[0178] It can be understood that the time period during which the R-frame first image is displayed on the screen of the device 101 is different from the time period during which the N-frame first image is displayed on the screen of the first device. For example, the R-frame first image is displayed before the N-frame first image, and the R+1-th frame displays the first-frame first image of the N-frame. In this way, the device 102 can determine the position of the first-frame first image of the N-frame based on the R-frame first image when scanning the R-frame first image and the N-frame first image, and then determine the N-frame first image. For another example, the R-frame first image is displayed after the N-frame first image, and the N+1-th frame displays the first-frame first image of the R-frame. In this way, the device 102 can determine the position of the N-frame first image of the N-frame based on the R-frame first image when scanning the R-frame first image and the N-frame first image, and then determine the N-frame first image.

[0179] It is understandable that, in order to solve the inverse pi problem, R signals may be configured to correspond to Z signals among N signals, where Z is an integer greater than 1 and less than N. For example, the R signals correspond to the first Z signals among the N signals, so that the device 102 determines the bit values ​​corresponding to the first N signals among the N signals based on the R signals.

[0180] It can be understood that if the first image is divided into regions, the synchronization sequences corresponding to different regions may be the same or different.

[0181] Optionally, in one possible implementation of the method shown in FIG3 , device 101 and device 102 can be connected to the same network, such as a first network. Device 101 can obtain a first shooting frame rate and set the screen refresh rate of device 101 based on the first shooting frame rate. For example, the screen refresh rate of device 101 can be set to be equal to the first shooting frame rate. The first shooting frame rate is the lowest shooting frame rate supported by devices with camera functions on the first network. The shooting frame rates supported by devices with camera functions on the first network can be the maximum shooting frame rate, the minimum shooting frame rate, the shooting frame rate corresponding to a specific shooting scene, or the commonly used shooting frame rate, without limitation. Device 102 can obtain the first shooting frame rate and set the shooting frame rate of the camera function based on the first shooting frame rate. For example, the shooting frame rate of the camera function can be set to be greater than or equal to the first shooting frame rate. In this way, the shooting frame rate of the camera function of device 102 can be greater than or equal to the screen refresh rate of device 101, so that device 102 can scan N frames of the first image and obtain V frames of the third image. In the present application, the shooting frame rate of the camera function of the device 102 may be equal to the first shooting frame rate, or equal to 2 times, 3 times, 4 times or 5 times, etc., of the first shooting frame rate.

[0182] Optionally, device 102 may send second indication information to a device in the first network used to determine the first shooting frame rate, such as device 103, where the second indication information indicates a shooting frame rate supported by device 102, so that device 103 can determine the first shooting frame rate. The shooting frame rate supported by device 102 includes at least one of a maximum shooting frame rate supported by device 102, a minimum shooting frame rate supported by device 102, or a shooting frame rate commonly used by device 102.

[0183] Exemplarily, the first network includes a smart screen (corresponding to the above-mentioned device 101), a mobile phone (corresponding to the above-mentioned device 102), a whole-house smart host (corresponding to the above-mentioned device 103) and a pad as an example to introduce the situation where the above-mentioned devices access the first network. As shown in Figure 7, the pad is the first device to access the network. After the pad accesses the first network, it sends a shooting frame rate 1 to the whole-house smart host. After the whole-house smart host receives the shooting frame rate 1, it determines the shooting frame rate 1 as the first shooting frame rate. After the smart screen accesses the first network, the whole-house smart host sends the shooting frame rate 1 to the smart screen, so that the smart screen sets the screen refresh rate according to the shooting frame rate 1 after turning on the screen communication function. After the mobile phone accesses the first network, it sends the shooting frame rate 2 to the whole-house smart host. If the shooting frame rate 2 is less than the shooting frame rate 1, the whole-house smart host determines the shooting frame rate 2 as the first shooting frame rate after receiving the shooting frame rate 2, and sends the shooting frame rate 2 to the smart screen, so that the smart screen sets the screen refresh rate according to the shooting frame rate 2 after turning on the screen communication function. The whole-house smart host also sends the shooting frame rate 2 to the pad, so that after the screen communication function is turned on, the pad sets the screen refresh rate according to the shooting frame rate 2, or so that when the pad communicates with the smart screen, the shooting frame rate of the camera module is set according to the shooting frame rate 2. It is understandable that if the mobile phone subsequently exits the first network, the whole-house smart host can re-determine the first shooting frame rate in the first network.

[0184] In order to better understand the method provided by this application, the following is an example of the short-distance communication method provided by this application, taking the information to be sent as a PIN code, and the first network including a smart screen (corresponding to the above-mentioned device 101), a mobile phone (corresponding to the above-mentioned device 102), a whole-house smart host (corresponding to the above-mentioned device 103) and a pad as an example to introduce the complete process of the short-distance communication method provided by this application. It should be understood that the introduction of each feature and step in the method shown in Figure 8 below is applicable to the method shown in Figure 3 above, and the introduction of each feature and step in the method shown in Figure 3 above is also applicable to the method shown in Figure 8 below.

[0185] As shown in FIG8 , another short-distance communication method provided by the present application may include the following steps:

[0186] S801: The whole-house smart host synchronizes the first shooting frame rate to the smart screen, mobile phone and pad respectively.

[0187] The specific process of S801 can refer to the corresponding description of FIG. 7 above, and will not be described in detail.

[0188] Optionally, the whole-house smart host also generates a corresponding PIN code for the screen device in the first network, obtains a PIN code table, and synchronizes the PIN code table to the smart screen, mobile phone, and pad respectively. In this example, the PIN code table includes the PIN code of the smart screen, the PIN code of the pad, and the PIN code of the mobile phone. For example, the PIN code table is shown in Table 1. In Table 1, the PIN code of the smart screen is 654-555, the PIN code of the pad is 654-154, and the PIN code of the mobile phone is 334-144.

[0189] Table 1

[0190] S802: The mobile phone broadcasts a first instruction message within the first network, instructing to enable the screen communication function. In response, the smart screen and the pad receive the first instruction message respectively.

[0191] It is understandable that when a mobile phone user wants to communicate with a device with a screen in the first network, the mobile phone can be triggered to broadcast the first indication information in the first network.

[0192] S803: The smart screen turns on the screen communication function, obtains a first digital sequence based on the PIN code of the smart screen, and displays N frames of the first image on the screen.

[0193] S804: The pad turns on the screen communication function, obtains a first digital sequence based on the PIN code of the pad, and displays N frames of the first image on the screen.

[0194] It is understood that the processes of S803 and S804 are similar to the processes of S301-S303. For details, please refer to the corresponding descriptions of S301-S303. It should be understood that the first digital sequence modulated by the smart screen is different from the first digital sequence modulated by the pad, and the N frames of the first image displayed on the smart screen are also different from the N frames of the first image displayed on the pad.

[0195] It is understandable that the present application does not limit the execution order of S803-S804. For example, S803 may be executed first and then S804, or S804 may be executed first and then S803, or S803 and S804 may be executed simultaneously.

[0196] S805: The user gesture triggers the mobile phone to turn on the camera function and set corresponding parameters.

[0197] S806: The mobile phone displays prompt information 1 to guide the user to shoot the N-frame first image displayed on the smart screen, and demodulate it to obtain a set of PIN codes.

[0198] In this application, the prompt information 1 may include a camera preview interface and a shooting timing frame. The user's shooting time is greater than or equal to a preset time so that the mobile phone can shoot a complete N-frame first image.

[0199] Optionally, the phone calculates the confidence level of the PIN code. For example, the phone calculates the confidence level based on the noise variance and noise power of the received signal. If the confidence level is less than a threshold, the phone can instruct the user to take another photo. In this example, it is assumed that the confidence level is greater than or equal to the threshold.

[0200] S807: The mobile phone establishes a connection with the smart screen based on the PIN code.

[0201] One possible implementation method is that the mobile phone searches for the set of PIN codes in the PIN code table. If the code is found, a connection is established with the smart screen based on the set of PIN codes. Optionally, if the connection is successful, the mobile phone also displays prompt information 2, such as successful connection; if the connection fails, the mobile phone can guide the user to reshoot. If the code is not found, the mobile phone can guide the user to reshoot. Optionally, the mobile phone can also display prompt information 3 based on the demodulation information. For example, if the signal is weak during the demodulation process, the mobile phone can display that there is no target within the shooting range, and the mobile phone can subsequently guide the user to aim the camera at the target. If the shooting information is found to be incomplete during the demodulation process, the mobile phone can display that the shooting time is too short, and the mobile phone can subsequently guide the user to increase the shooting time. If the signal characteristics are found to change significantly during the demodulation process, the mobile phone can display that the shooting is shaking violently, and the mobile phone can subsequently guide the user to shoot steadily.

[0202] In one possible implementation, the mobile phone establishes a connection with the smart screen via wireless means such as WiFi or Bluetooth. For example, the mobile phone sends the set PIN code to the smart screen via WiFi or Bluetooth, and the smart screen connects to the mobile phone based on the set PIN code after receiving the set PIN code.

[0203] It can be understood that if the center frequency f of the modulation signal c =30Hz, the lowest frequency of the modulation signal f l =15Hz, the screen refresh rate of the smart screen is 60FPS. In the slow playback mode of the screen, the PIN code (6 digits) of the smart screen requires 20 bits, corresponding to 1.33 seconds of playback. Therefore, the method of the present application can enable the mobile phone to establish a connection with the smart screen within 1.5 seconds, with strong directionality and simple user operation. The range of the mobile phone scanning the smart screen can be about 1 meter or more than 1 meter, and the specific range is related to the size of the smart screen.

[0204] Optionally, the mobile phone may broadcast a third instruction message in the first network, indicating that the screen communication function is to be turned off.

[0205] Optionally, if the smart screen exits the first network, the whole-house smart host may delete the smart screen's PIN code and broadcast the latest PIN code table in the first network. If the mobile phone exits the first network, the whole-house smart host may delete the mobile phone's PIN code, update the first shooting frame rate, and broadcast the latest PIN code table and the updated first shooting frame rate in the first network. If the pad exits the first network, the whole-house smart host may delete the pad's PIN code, update the first shooting frame rate, and broadcast the latest PIN code table and the updated first shooting frame rate in the first network.

[0206] It can be understood that the actions of the whole-house smart host or mobile phone or smart screen or pad in the above S801-S807 can be executed by the processor 210 in the electronic device 20 shown in Figure 2 calling the application code stored in the memory 221, and this application does not impose any restrictions on this.

[0207] In some embodiments, when the user of a mobile phone wants to communicate with a device with a screen (such as a smart screen or pad) in the first network, the mobile phone can be triggered to communicate with device 103 (such as a whole-house smart host), and device 103 communicates with device 101 (such as a smart screen or pad), so that device 101 (such as a smart screen or pad) turns on the screen communication function.

[0208] The various embodiments mentioned above in this application can be combined without limitation if there is no contradiction between the solutions.

[0209] The above description primarily describes the solution provided by this application from the perspective of interaction between various devices. Accordingly, this application also provides an electronic device, which may be device 101 in the above-described method embodiment, or an apparatus comprising device 101, or a component usable for device 101; alternatively, this electronic device may be device 102 in the above-described method embodiment, or an apparatus comprising device 102, or a component usable for device 102. It will be understood that, in order to implement the aforementioned functions, the aforementioned devices 101 or 102 include hardware structures and / or software modules corresponding to the respective functions. Those skilled in the art will readily appreciate that, in conjunction with the various exemplary units and algorithmic operations described in the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is implemented in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this application.

[0210] The present application can divide the functional modules of device 101 or device 102 according to the above method examples. For example, each functional module can be divided according to each function, or two or more functions can be integrated into a processing module. The above integrated modules can be implemented in the form of hardware or software functional modules. It is understood that the division of modules in this application is schematic and is only a logical functional division. In actual implementation, other division methods may be used.

[0211] For example, in the case of dividing the various functional modules in an integrated manner, FIG9 shows a schematic structural diagram of an electronic device 90. The electronic device 90 includes a processing module 901 and a display module 902. Optionally, the electronic device 90 also includes an interface module 903. The processing module 901, which may also be referred to as a processing unit, is used to perform operations other than transceiver operations and display operations, and may be, for example, a processing circuit or a processor. The display module 902, which may also be referred to as a display unit, is used to perform display operations, and may be, for example, a display screen. The interface module 903, which may also be referred to as an interface unit, is used to perform transceiver operations, and may be, for example, an interface circuit, a transceiver, a transceiver or a communication interface.

[0212] In some embodiments, the electronic device 90 may further include a storage module (not shown in FIG. 9 ) for storing program instructions and data.

[0213] Exemplarily, the electronic device 90 is used to implement the functions of the device 101. The electronic device 90 is, for example, the device 101 described in the embodiment shown in FIG3 , or the smart screen or pad described in the embodiment shown in FIG8 .

[0214] The processing module 901 is configured to obtain a first digital sequence based on the information to be sent, wherein the first digital sequence indicates N signals, where N is an integer greater than 1. For example, the processing module 901 may be configured to execute S302.

[0215] Display module 902 is configured to continuously display N frames of first image on the screen of a first device. The N frames of first image correspond to N consecutive frames of second image, respectively. The N frames of second image are images displayed on the screen of the first device when the screen communication function of the first device is not enabled. The user's visual perception of the N frames of first image is the same as the user's visual perception of the N frames of second image. The variation pattern of the color information of the N frames of first image is related to the variation pattern of N signals. The color information of the i-th frame of the first image indicates the color accumulation value of the pixel points in the i-th frame of the first image, where i is an integer greater than 1 and less than or equal to N. For example, display module 902 can be configured to execute S303.

[0216] A possible implementation method is that the user's visual perception results of N frames of first image and the user's visual perception results of N frames of second image are the same, including: the screen refresh rate of the first device is greater than or equal to a first threshold; the absolute value of the difference between the brightness of the first pixel point in the i-th frame of the first image and the brightness of the first pixel point in the i-th frame of the second image is less than or equal to the second threshold, and the first pixel point is any pixel point on the screen of the first device; the absolute value of the difference between the first color information and the second color information is less than or equal to a third threshold, the first color information is the color information of the first pixel point in M ​​consecutive frames of the first image in N frames, and the second color information is the color information of the first pixel point in M ​​frames of the second image corresponding to the M frames of the first image, where M is an integer greater than 1 and less than or equal to N.

[0217] In a possible implementation, the processing module 901 is specifically configured to modulate the information to be transmitted at a first bandwidth and a first frequency to obtain a first digital sequence.

[0218] In one possible implementation, the changing pattern of the color information of the N frames of first images is related to the changing pattern of N signals, including: within a first bandwidth, the changing pattern of the color information of the N frames of first images is related to the changing pattern of the N signals in frequency, or the changing pattern of the color information of the N frames of first images is related to the changing pattern of the N signals in the time domain.

[0219] In one possible implementation, the first frequency is less than or equal to half of a screen refresh rate of the first device.

[0220] In one possible implementation, the display module 902 is further used to continuously display R-frame first images on the screen of the first device, where the R-frame first images correspond to continuous R-frame second images respectively, and the R-frame second images are images displayed on the screen of the first device when the screen communication function of the first device is not turned on. The user's visual perception result of the R-frame first image is the same as the user's visual perception result of the R-frame second image. The change pattern of the color information of the R-frame first image is related to the change pattern of R signals. The color information of the j-th frame first image indicates the color cumulative value of the pixel points in the j-th frame first image. The R signals are signals indicated by the synchronization sequence, R is an integer greater than 1, j is an integer greater than 1 and less than or equal to R, and the time period when the R-frame first image is displayed on the screen of the first device is different from the time period when the N-frame first image is displayed on the screen of the first device.

[0221] In a possible implementation, the processing module 901 is further configured to obtain a synchronization sequence, where the synchronization sequence is modulated on a second frequency, and the second frequency is different from the first frequency.

[0222] In a possible implementation, the display module 902 is specifically configured to fuse the N signals with the N frames of the second image respectively, and continuously display the N frames of the first image on the screen of the first device.

[0223] In one possible implementation, each frame of the first image includes P areas, and the positions and sizes of the P areas included in any two frames of the first image are the same. The first digital sequence also indicates (P-1)*N signals. The first digital sequence includes P segment sequences, each segment sequence indicates N consecutive signals among the P*N signals, and the P areas correspond to the P segment sequences respectively. The change pattern of the N frames of color information in each area is related to the change pattern of the N consecutive signals corresponding to the area, and P is an integer greater than 1.

[0224] In a possible implementation, a variation pattern of brightness information of N frames of first images is related to a variation pattern of N signals.

[0225] In a possible implementation, the brightness information of the first image of the i-th frame indicates the accumulated brightness value of the pixels in the first image of the i-th frame.

[0226] In one possible implementation, a variation pattern of brightness information of N frames of first images is related to a variation pattern of N signals, including: within a first bandwidth, the variation pattern of brightness information of N frames of first images is consistent with the variation pattern of N signals in the frequency domain, or the variation pattern of brightness information of N frames of first images is linearly correlated with the variation pattern of N signals in the time domain; and the first bandwidth is a modulation bandwidth of the first digital sequence.

[0227] In one possible implementation, each frame of the first image includes P areas, and the positions and sizes of the P areas included in any two frames of the first image are the same. The first digital sequence also indicates (P-1)*N signals. The first digital sequence includes P segment sequences, each segment sequence indicates N continuous signals among the P*N signals, and the P areas correspond to the P segment sequences respectively. The change pattern of the N frames of brightness information in each area is related to the change pattern of the N continuous signals corresponding to the area, and P is an integer greater than 1.

[0228] In one possible implementation, the interface module 903 is used to access the first network; the processing module 901 is also used to obtain a first shooting frame rate, which is the lowest shooting frame rate supported by devices with camera functions in the first network; the processing module 901 is also used to set the screen refresh rate of the first device according to the first shooting frame rate.

[0229] In a possible implementation, the interface module 903 is further configured to receive first indication information, where the first indication information indicates to enable the screen communication function.

[0230] When used to implement the functions of the device 101, regarding other functions that the electronic device 90 can implement, reference can be made to the relevant introduction of the embodiment shown in FIG3 or the embodiment shown in FIG8, and no further details will be given.

[0231] In a simple embodiment, those skilled in the art can imagine that the electronic device 90 can adopt the form shown in Figure 2. For example, the processor 210 in Figure 2 can call the computer-executable instructions stored in the memory 221 to enable the electronic device 90 to perform the method described in the above method embodiment.

[0232] Exemplarily, the functions / implementation processes of the processing module 901, the display module 902, and the interface module 903 in FIG9 can be implemented by the processor 210 in FIG2 calling computer-executable instructions stored in the memory 221. Alternatively, the functions / implementation processes of the processing module 901 in FIG9 can be implemented by the processor 210 in FIG2 calling computer-executable instructions stored in the memory 221, the functions / implementation processes of the display module 902 in FIG9 can be implemented by the display screen 290 in FIG2, and the functions / implementation processes of the interface module 903 in FIG9 can be implemented by the mobile communication module 250 or the wireless communication module 260 in FIG2.

[0233] For example, FIG10 shows a schematic diagram of the structure of an electronic device 100, where the functional modules are divided in an integrated manner. The electronic device 100 includes a processing module 1001. Optionally, the electronic device 100 also includes an interface module 1002. The processing module 1001, which may also be referred to as a processing unit, is configured to perform operations other than transceiver operations and may be, for example, a processing circuit or a processor. The interface module 1002, which may also be referred to as an interface unit, is configured to perform transceiver operations and may be, for example, an interface circuit, a transceiver, a transceiver, or a communication interface.

[0234] In some embodiments, the electronic device 100 may further include a storage module (not shown in FIG. 10 ) for storing program instructions and data.

[0235] Exemplarily, the electronic device 100 is used to implement the functions of the device 102. The electronic device 100 is, for example, the device 102 described in the embodiment shown in FIG3 or the mobile phone described in the embodiment shown in FIG8.

[0236] The processing module 1001 is configured to scan N frames of first images displayed on the screen of the first device through a camera function and demodulate the images to be received, where N is an integer greater than 1. For example, the processing module 1001 may be configured to execute S304.

[0237] In one possible implementation, the interface module 1002 is used to access the first network; the processing module 1001 is also used to obtain a first shooting frame rate, which is the lowest shooting frame rate supported by the device with a camera function in the first network; the processing module 1001 is also used to set the shooting frame rate of the camera function according to the first shooting frame rate.

[0238] In a possible implementation, the interface module 1002 is further configured to send first indication information, where the first indication information indicates to enable the screen communication function.

[0239] In a possible implementation, the interface module 1002 is further configured to send second indication information, where the second indication information indicates a shooting frame rate supported by the second device.

[0240] When used to implement the functions of the device 102, regarding other functions that the electronic device 100 can implement, reference can be made to the relevant introduction of the embodiment shown in FIG3 or the embodiment shown in FIG8, and no further details will be given.

[0241] In a simple embodiment, those skilled in the art may imagine that the electronic device 100 may adopt the form shown in Figure 2. For example, the processor 210 in Figure 2 may call the computer-executable instructions stored in the memory 221 to enable the electronic device 100 to execute the method described in the above method embodiment.

[0242] Exemplarily, the functions / implementation processes of the processing module 1001 and the interface module 1002 in FIG10 may be implemented by the processor 210 in FIG2 calling computer-executable instructions stored in the memory 221. Alternatively, the functions / implementation processes of the processing module 1001 in FIG10 may be implemented by the processor 210 in FIG2 calling computer-executable instructions stored in the memory 221, and the functions / implementation processes of the interface module 1002 in FIG10 may be implemented by the mobile communication module 250 or the wireless communication module 260 in FIG2.

[0243] It is understandable that one or more of the above modules or units can be implemented by software, hardware or a combination of the two. When any of the above modules or units is implemented by software, the software exists in the form of computer program instructions and is stored in a memory, and a processor can be used to execute the program instructions and implement the above method flow. The processor can be built into an SoC (system on chip) or an ASIC, or it can be an independent semiconductor chip. In addition to the core used to execute software instructions to perform calculations or processing within the processor, it can further include necessary hardware accelerators, such as field programmable gate arrays (FPGAs), PLDs (programmable logic devices), or logic circuits that implement dedicated logic operations.

[0244] When the above modules or units are implemented in hardware, the hardware can be any one or any combination of a CPU, a microprocessor, a digital signal processing (DSP) chip, a microcontroller unit (MCU), an artificial intelligence processor, an ASIC, a SoC, an FPGA, a PLD, a dedicated digital circuit, a hardware accelerator or a non-integrated discrete device, which can run the necessary software or not rely on the software to execute the above method flow.

[0245] Optionally, the present application also provides a chip system, comprising: at least one processor and an interface, wherein the at least one processor is coupled to a memory via the interface, and when the at least one processor executes a computer program or instruction in the memory, the method in any of the above method embodiments is executed. In one possible implementation, the chip system also includes a memory. Optionally, the chip system can be composed of a chip, or can include a chip and other discrete devices, which is not specifically limited in this application.

[0246] Optionally, the present application also provides a computer-readable storage medium. All or part of the processes in the above-mentioned method embodiments can be completed by a computer program to instruct the relevant hardware, and the program can be stored in the above-mentioned computer-readable storage medium. When the program is executed, it may include the processes of the above-mentioned method embodiments. The computer-readable storage medium can be an internal storage unit of the electronic device of any of the aforementioned embodiments, such as a hard disk or memory of the electronic device. The above-mentioned computer-readable storage medium can also be an external storage device of the above-mentioned electronic device, such as a plug-in hard disk, a smart memory card (smart media card, SMC), a secure digital (secure digital, SD) card, a flash card (flash card), etc. equipped on the above-mentioned electronic device. Furthermore, the above-mentioned computer-readable storage medium can also include both the internal storage unit of the above-mentioned electronic device and an external storage device. The above-mentioned computer-readable storage medium is used to store the above-mentioned computer program and other programs and data required by the above-mentioned electronic device. The above-mentioned computer-readable storage medium can also be used to temporarily store data that has been output or is to be output.

[0247] Optionally, the present application also provides a computer program product. All or part of the processes in the above method embodiments may be completed by a computer program instructing related hardware. The program may be stored in the above computer program product, and when executed, the program may include the processes in the above method embodiments.

[0248] Optionally, the present application also provides a computer program (product). All or part of the processes in the above method embodiments can be completed by the computer program or instructions contained in the computer program (product) to instruct related hardware (such as a computer, processor, device 101 or device 102, etc.). The computer program or instructions can be stored in the above-mentioned computer-readable storage medium or in the above-mentioned computer program product.

[0249] Optionally, the present application further provides a communication system, including: the device 101 and the device 102 in the above embodiment. Optionally, the communication system further includes the device 103 in the above embodiment.

[0250] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0251] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0252] The units described as separate components may or may not be physically separate, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0253] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0254] The above is only a specific embodiment of the present application, but the scope of protection of this application is not limited to this. Any changes or substitutions within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A short-distance communication method, characterized in that: The method comprises: Obtaining a first digital sequence based on the information to be sent, where the first digital sequence indicates N signals, where N is an integer greater than 1; N frames of first images are continuously displayed on the screen of the first device, and the N frames of first images respectively correspond to N consecutive frames of second images. The N frames of second images are images displayed on the screen of the first device when the screen communication function of the first device is not turned on. The user's visual perception result of the N frames of first images is the same as the user's visual perception result of the N frames of second images. The change pattern of color information of the N frames of first images is related to the change pattern of the N signals. The color information of the i-th frame of the first image indicates the color accumulated value of the pixel points in the i-th frame of the first image, and i is an integer greater than 1 and less than or equal to N.

2. The method according to claim 1, characterized in that The visual perception results of the user on the N frames of the first image are the same as the visual perception results of the user on the N frames of the second image, including: The screen refresh rate of the first device is greater than or equal to a first threshold; An absolute value of a difference between a brightness of a first pixel point in the first image of the i-th frame and a brightness of the first pixel point in the second image of the i-th frame is less than or equal to a second threshold, and the first pixel point is any pixel point on the screen of the first device; The absolute value of the difference between the first color information and the second color information is less than or equal to a third threshold, the first color information is the color information of the first pixel in M ​​consecutive first images in the N frames, and the second color information is the color information of the first pixel in M ​​second images corresponding to the M first images, where M is an integer greater than 1 and less than or equal to N.

3. The method according to claim 1 or 2, characterized in that: The obtaining of a first digital sequence based on the information to be sent includes: The information to be sent is modulated at a first bandwidth and a first frequency to obtain the first digital sequence.

4. The method according to claim 3, characterized in that The changing rule of the color information of the N frames of the first image is related to the changing rule of the N signals, including: Within the first bandwidth, the change rule of the color information of the N frames of the first image is correlated with the change rule of the N signals in the frequency domain, or the change rule of the color information of the N frames of the first image is correlated with the change rule of the N signals in the time domain.

5. The method according to claim 3 or 4, characterized in that: The first frequency is less than or equal to half of a screen refresh rate of the first device.

6. The method according to any one of claims 3 to 5, characterized in that: The method further comprises: R frames of first images are continuously displayed on the screen of the first device, the R frames of first images respectively correspond to continuous R frames of second images, the R frames of second images are images displayed on the screen of the first device when the screen communication function of the first device is not turned on, a visual perception result of the user for the R frames of first images is the same as a visual perception result of the user for the R frames of second images, a change rule of color information of the R frames of first images is related to a change rule of R signals, the color information of the j-th frame of first image indicates the color accumulation value of the pixel points in the j-th frame of first image, the R signals are signals indicated by a synchronization sequence, R is an integer greater than 1, j is an integer greater than 1 and less than or equal to R, and a time period during which the R frames of first images are displayed on the screen of the first device is different from a time period during which the N frames of first images are displayed on the screen of the first device.

7. The method according to claim 6, characterized in that The method further comprises: The synchronization sequence is acquired, where the synchronization sequence is modulated on a second frequency, where the second frequency is different from the first frequency.

8. The method according to any one of claims 1 to 7, characterized in that The continuously displaying N frames of the first image on the screen of the first device includes: fusing the N signals with the N frames of the second image respectively, and continuously displaying the N frames of the first image on the screen of the first device.

9. The method according to any one of claims 1 to 8, characterized in that Each frame of the first image includes P areas, and the positions and sizes of the P areas included in any two frames of the first image are the same. The first digital sequence also indicates (P-1)*N signals. The first digital sequence includes P segment sequences, and each segment sequence indicates N continuous signals among the P*N signals. The P areas correspond to the P segment sequences respectively. The change law of the N frames of color information in each area is related to the change law of the N continuous signals corresponding to the area, and P is an integer greater than 1.

10. The method according to any one of claims 1 to 9, characterized in that The variation rule of the brightness information of the N frames of the first image is related to the variation rule of the N signals.

11. The method according to claim 10, characterized in that The brightness information of the i-th frame first image indicates the brightness accumulation value of the pixel points in the i-th frame first image.

12. The method according to claim 10 or 11, characterized in that: The variation rule of the brightness information of the N frames of the first image is related to the variation rule of the N signals, including: Within the first bandwidth, the changing law of the brightness information of the N frames of the first image is correlated with the changing law of the N signals in the frequency domain, or the changing law of the brightness information of the N frames of the first image is correlated with the changing law of the N signals in the time domain; the first bandwidth is the modulation bandwidth of the first digital sequence.

13. The method according to any one of claims 10 to 12, characterized in that: Each frame of the first image includes P areas, and the positions and sizes of the P areas included in any two frames of the first image are the same. The first digital sequence also indicates (P-1)*N signals. The first digital sequence includes P segment sequences, and each segment sequence indicates N continuous signals among the P*N signals. The P areas correspond to the P segment sequences respectively. The change law of the N frames of brightness information in each area is related to the change law of the N continuous signals corresponding to the area, and P is an integer greater than 1.

14. The method according to any one of claims 1 to 13, characterized in that The method further comprises: Accessing the first network; Obtaining a first shooting frame rate, where the first shooting frame rate is the lowest shooting frame rate among shooting frame rates supported by the device with a camera function in the first network; The screen refresh rate of the first device is set according to the first shooting frame rate.

15. The method according to any one of claims 1 to 14, characterized in that The method further comprises: First indication information is received, where the first indication information indicates to enable the screen communication function.

16. An electronic device, characterized in that: The electronic device comprises: a processing module and a display module; wherein The processing module is used to obtain a first digital sequence based on the information to be sent, where the first digital sequence indicates N signals, where N is an integer greater than 1; The display module is used to continuously display N frames of first images on the screen of the electronic device, wherein the N frames of first images respectively correspond to N consecutive frames of second images, and the N frames of second images are images displayed on the screen of the electronic device when the screen communication function of the electronic device is not turned on. The user's visual perception result of the N frames of first images is the same as the user's visual perception result of the N frames of second images. The change pattern of color information of the N frames of first images is related to the change pattern of the N signals. The color information of the i-th frame of the first image indicates the color accumulated value of the pixel points in the i-th frame of the first image, and i is an integer greater than 1 and less than or equal to N.

17. The electronic device according to claim 16, characterized in that: The visual perception results of the user on the N frames of the first image are the same as the visual perception results of the user on the N frames of the second image, including: The screen refresh rate of the electronic device is greater than or equal to a first threshold; An absolute value of a difference between a brightness of a first pixel point in the first image of the i-th frame and a brightness of the first pixel point in the second image of the i-th frame is less than or equal to a second threshold, and the first pixel point is any pixel point on the screen of the electronic device; The absolute value of the difference between the first color information and the second color information is less than or equal to a third threshold, the first color information is the color information of the first pixel in M ​​consecutive first images in the N frames, and the second color information is the color information of the first pixel in M ​​second images corresponding to the M first images, where M is an integer greater than 1 and less than or equal to N.

18. The electronic device according to claim 16 or 17, characterized in that: The processing module is specifically configured to modulate the information to be sent at a first bandwidth and a first frequency to obtain the first digital sequence.

19. The electronic device according to claim 18, characterized in that: The changing rule of the color information of the N frames of the first image is related to the changing rule of the N signals, including: Within the first bandwidth, the change rule of the color information of the N frames of the first image is correlated with the change rule of the N signals in the frequency domain, or the change rule of the color information of the N frames of the first image is correlated with the change rule of the N signals in the time domain.

20. The electronic device according to claim 18 or 19, characterized in that: The first frequency is less than or equal to half of a screen refresh rate of the electronic device.

21. The electronic device according to any one of claims 18 to 20, characterized in that: The display module is further used to continuously display R frame first images on the screen of the electronic device, the R frame first images respectively corresponding to continuous R frame second images, the R frame second images are images displayed on the screen of the electronic device when the screen communication function of the electronic device is not turned on, the user's visual perception result of the R frame first images is the same as the user's visual perception result of the R frame second images, the change law of the color information of the R frame first images is related to the change law of R signals, the color information of the j-th frame first image indicates the color accumulated value of the pixel points in the j-th frame first image, the R signals are signals indicated by synchronization sequences, R is an integer greater than 1, j is an integer greater than 1 and less than or equal to R, and the time period for which the R frame first images are displayed on the screen of the electronic device is different from the time period for which the N-frame first images are displayed on the screen of the electronic device.

22. The electronic device according to claim 21, characterized in that: The processing module is further used to obtain the synchronization sequence, where the synchronization sequence is modulated on a second frequency, and the second frequency is different from the first frequency.

23. The electronic device according to any one of claims 16 to 22, characterized in that: The display module is specifically used to fuse the N signals with the N frames of second images respectively, and continuously display the N frames of first images on the screen of the electronic device.

24. The electronic device according to any one of claims 16 to 23, characterized in that: Each frame of the first image includes P areas, and the positions and sizes of the P areas included in any two frames of the first image are the same. The first digital sequence also indicates (P-1)*N signals. The first digital sequence includes P segment sequences, and each segment sequence indicates N continuous signals among the P*N signals. The P areas correspond to the P segment sequences respectively. The change law of the N frames of color information in each area is related to the change law of the N continuous signals corresponding to the area, and P is an integer greater than 1.

25. The electronic device according to any one of claims 16 to 24, characterized in that: The variation rule of the brightness information of the N frames of the first image is related to the variation rule of the N signals.

26. The electronic device according to claim 25, characterized in that: The brightness information of the i-th frame first image indicates the brightness accumulation value of the pixel points in the i-th frame first image.

27. The electronic device according to claim 25 or 26, characterized in that: The changing law of the brightness information of the N frames of the first image is related to the changing law of the N signals, including: within a first bandwidth, the changing law of the brightness information of the N frames of the first image is related to the changing law of the N signals in the frequency domain, or the changing law of the brightness information of the N frames of the first image is related to the changing law of the N signals in the time domain; the first bandwidth is the modulation bandwidth of the first digital sequence.

28. The electronic device according to any one of claims 25 to 27, characterized in that: Each frame of the first image includes P areas, and the positions and sizes of the P areas included in any two frames of the first image are the same. The first digital sequence also indicates (P-1)*N signals. The first digital sequence includes P segment sequences, and each segment sequence indicates N continuous signals among the P*N signals. The P areas correspond to the P segment sequences respectively. The change law of the N frames of brightness information in each area is related to the change law of the N continuous signals corresponding to the area, and P is an integer greater than 1.

29. The electronic device according to any one of claims 16 to 28, characterized in that: The electronic device further comprises: an interface module; The interface module is used to access the first network; The processing module is further used to obtain a first shooting frame rate, where the first shooting frame rate is the lowest shooting frame rate among the shooting frame rates supported by the device with a camera function in the first network; The processing module is further used to set the screen refresh rate of the electronic device according to the first shooting frame rate.

30. The electronic device according to any one of claims 16 to 29, characterized in that: The electronic device further comprises: an interface module; The interface module is used to receive first indication information, where the first indication information indicates to enable the screen communication function.

31. An electronic device, characterized in that: include: A processor, the processor is coupled to a memory, the memory is used to store programs or instructions, when the program or instructions are executed by the processor, the electronic device executes the method as claimed in any one of claims 1 to 15.

32. A chip, characterized in that: include: A processor, wherein the processor is coupled to a memory, wherein the memory is used to store programs or instructions, and when the programs or instructions are executed by the processor, the chip executes the method as claimed in any one of claims 1 to 15.

33. A computer-readable storage medium having a computer program or instruction stored thereon, characterized in that: When the computer program or instructions are executed, the computer is caused to perform the method according to any one of claims 1 to 15.

34. A computer program product, comprising computer program code, characterized in that: When the computer program code is executed on a computer, the computer is caused to implement the method according to any one of claims 1 to 15.

35. A communication system, characterized in that: The communication system includes: an electronic device as described in any one of claims 16 to 30, and a second device, wherein the second device is used to scan N frames of first images displayed on the screen of the electronic device through a camera function, and demodulate to obtain information to be received.

Images