Data transmission method based on Bluetooth low energy (BLE), communication system and intelligent glasses

Abstract

The invention discloses a data transmission method based on Bluetooth Low Energy (BLE), a communication system and intelligent glasses, and relates to the technical field of wireless communication. The method transmits image data from a wearable device to a mobile device through an extended periodic broadcast link; the expanded periodic broadcast link is a periodic broadcast in a Wi-Fi mode expanded by configuring parameters of a broadcast packet based on the broadcast packet set in the BLE periodic broadcast, and an anchor point sent by the periodic broadcast is still specified according to a BLE protocol; and the image data is sent out by adopting a related protocol of 802.11 through periodic broadcasting of the Wi-Fi mode. Based on the photo transmission requirement of the wearable device, a solution with low power consumption, low storage capacity and high transmission rate is provided, and low-power-consumption and high-efficiency data transmission service is realized.

Description

Technical Field

[0001] The present invention relates to the field of wireless communication technologies, and in particular, to a data transmission method, a communication system, and smart glasses based on Bluetooth Low Energy (BLE). Background Art

[0002] Some wearable intelligent products enabled with electronic devices (such as smart glasses) allow users to selectively collect image data (including pictures and videos) while they are engaged in activities. Such wearable devices include an integrated camera that can be selectively activated to collect images. By enabling the camera, users can take digital photos / video data that they expect to record and store, and subsequently, such images and videos can be downloaded to the user's mobile device (such as a mobile phone) and shared with other users. Taking smart glasses as an example, some existing smart glasses products can provide a trip snapshot function, which means that when the user wears the glasses, the glasses can take pictures at a certain interval from the first perspective (the pictures are taken by the camera on the glasses) to record the user's daily views.

[0003] At present, due to the limitations of the volume and weight of smart glasses themselves, it is impossible to have a large battery capacity and data storage capacity in product design, resulting in a short battery life. When using the above-mentioned itinerary snapshot function, the following characteristics exist: First, due to the limitation of the battery capacity, in order to extend the usage time of the glasses, it is impossible for users to take pictures at a very high frame rate. Existing designs usually support users to take pictures at second-level intervals (such as 1 second, 5 seconds, 10 seconds, etc.) to balance power consumption and device usage time. Second, due to the small data storage space, it is difficult to store all the image data captured by the camera locally on the glasses. Therefore, it is necessary to transmit it wirelessly to a client device with a larger storage capacity to store the above-mentioned image data. Specifically, for the convenience of users to view and process images, the client device with a large storage capacity is usually a mobile device carried by the user - such as a mobile phone, a tablet computer, etc. The wireless transmission technologies used usually include Bluetooth technology, Wi-Fi technology, etc.; among them, considering the usage time of the device, the low-power Bluetooth BLE protocol is usually used for data transmission between the smart glasses and the portable device to meet the low-power requirements of the device (too high transmission power consumption will shorten the usage time of the device). Further, the prior art also provides a solution of compressing the captured image before transmission. As an example, for instance, Chinese Patent ZL201810116753.7 discloses a method, device, camera and portable terminal for controlling a camera via Bluetooth. The method includes: a camera with a Bluetooth module turns on the shooting function; after the camera receives a Bluetooth connection request sent by a portable terminal with a Bluetooth module to the camera via Bluetooth, the camera and the portable terminal establish a Bluetooth connection, and the Bluetooth modules of both the camera and the portable terminal support the low-power Bluetooth protocol BLE; after the camera receives a shooting instruction sent by the portable terminal via Bluetooth, it takes a picture; after the camera finishes taking pictures, it compresses the taken picture into a thumbnail, and the camera uses an asynchronous transmission method to send the thumbnail to the portable terminal via Bluetooth. In the above solution, the low-power Bluetooth protocol is used for remote Bluetooth control and transmission between the camera and the portable terminal, and after the camera compresses the taken picture into a thumbnail, it sends the thumbnail to the portable terminal via Bluetooth, reducing the power consumption of the camera, extending the standby time of the camera, and being able to reduce bandwidth transmission and improve the user experience.

[0004] The above-mentioned existing technologies have the following defects: on the one hand, although the existing Bluetooth Low Energy (BLE) protocol can achieve convenient, fast, flexible, safe, low-cost, and low-power data communication between devices, and also endeavors to enhance the data rate mode to balance low power consumption and high transmission rate, it is still difficult to meet the data transmission requirements of the itinerary snapshot scenario of wearable devices. On the other hand, the storage device used to receive and save the snapshot data of the glasses is usually configured as a single device. If the power of this storage device is insufficient, it will cause the snapshot data of the glasses to be unable to be uploaded continuously. On the further hand, after the camera takes a photo, it performs image compression processing and transmission. The single-shot transmission method results in high radio frequency overhead of the device and increases the wireless transmission pressure.

[0005] Accordingly, based on the photo transmission requirements of wearable devices (such as smart glasses), the present invention provides a solution with low power consumption, low storage capacity, and high transmission rate. Summary of the Invention

[0006] The object of the present invention is to: overcome the deficiencies of the prior art and provide a data transmission method, communication system, and smart glasses based on Bluetooth Low Energy (BLE). Specifically, the present invention is based on the extended BLE periodic broadcast (or cycle broadcast) technology provided in Chinese Patent Application CN202510281097.6, combines the data transmission characteristics and requirements of wearable devices, and establishes a low-power and high-efficiency data transmission service on the extended periodic broadcast; and, by further expanding the BLE cycle broadcast, provides the switching between relevant services without passing through storage devices, so as to increase the flexibility of data transmission and improve the reliability of the system, which is particularly applicable to the itinerary snapshot function of wearable devices.

[0007] To achieve the above object, the present invention provides the following technical solutions: A data transmission method based on Bluetooth Low Energy (BLE) is used for communication between a wearable device and a mobile device. Among them, communication is carried out between the wearable device and the mobile device through an extended cycle broadcast link to transmit image data from the wearable device to the mobile device. The wearable device is the cycle broadcast source end Source, and the mobile device is the cycle broadcast receiving end Sink; The extended cycle broadcast link is a Wi-Fi mode cycle broadcast extended based on the broadcast packet set in the BLE cycle broadcast by configuring the parameters of the broadcast packet. The cycle broadcast transmission anchor point still follows the BLE protocol specification; the image data is sent out through the Wi-Fi mode cycle broadcast by using the relevant protocols of 802.11.

[0008] Further, the wearable device is a smart glasses, which is used to take itinerary snapshots and form an image data set including multiple itinerary snapshots; The smart glasses are configured to: according to its own memory capacity, compress and package multiple consecutive snapshots to form the image dataset; and, when the periodic broadcast arrives, send the image dataset out at one time through the periodic broadcast in the Wi-Fi mode.

[0009] Further, the number of mobile devices is one or more. When there are multiple mobile devices, the data reception strategy of the mobile devices is configured as follows: a. Select one mobile device from the multiple mobile devices as the periodic broadcast receiving end Sink. When the current periodic broadcast receiving end Sink cannot receive broadcast data normally, select another mobile device from the aforementioned multiple mobile devices as the periodic broadcast receiving end Sink to continue receiving broadcast data; or b. Select multiple mobile devices as the periodic broadcast receiving end Sink to receive broadcast data simultaneously. At this time, the broadcast data is configured in a non-retransmission mode.

[0010] Further, when there are multiple mobile devices, it includes a first type of mobile device and a second type of mobile device; The first type of mobile device is a device with a human-computer interaction interface, which is configured to: as the periodic broadcast receiving end Sink, periodically receive data from the periodic broadcast source end Source, save and perform corresponding processing; and, as the periodic broadcast assistant end Assistant, assist the second type of mobile device to synchronize with the periodic broadcast source end Source. At this time, the first type of mobile device and the second type of mobile device communicate bidirectionally through the BLE link; The second type of mobile device is a device without a human-computer interaction interface, which needs to use the first type of mobile device as the periodic broadcast assistant end Assistant to assist in searching for the periodic broadcast source end Source and perform corresponding security authentication to parse the data; the second type of mobile device is configured to: as the periodic broadcast receiving end Sink, communicate with the periodic broadcast assistant end Assistant through the BLE link to obtain the parameters required for synchronizing with the periodic broadcast source end Source, and, after synchronizing with the periodic broadcast source end Source, periodically receive data from the periodic broadcast source end Source, save and perform corresponding processing.

[0011] Further, the General Access Profile (GAP) of the BLE protocol is extended, and two new services Service and a sub-profile Profile for managing these two services are added on the original protocol layer; among them, the first service is the Picture Publication Service (PPS) related to picture publication, the second service is the Broadcast Source Configuration Service (BSCS) related to broadcast source configuration, and the sub-profile is the Picture Transmission Profile (PP) related to wearable device pictures; the two services are parallel and independent service layers, both located above the GATT layer; the sub-profile is based on these two services and is located above the two service layers; Among them, the first service runs on a wearable device that serves as a periodic broadcast source end (Source), and is used to broadcast and indicate the structure and configuration information of the current data stream; The second service runs on a mobile device that serves as a periodic broadcast receiving end (Sink). For the first type of mobile device, when it serves as a periodic broadcast assistant end (Assistant), the second service is used to configure other periodic broadcast receiving ends (Sink) to synchronize with the periodic broadcast source end (Source); The sub - specification runs on the wearable device or the first type of mobile device. When the sub - specification runs on the first type of mobile device, the first type of mobile device communicates with the wearable device through a BLE link to configure the first service running on the wearable device.

[0012] Furthermore, corresponding to the PPS of the first service, a corresponding service number UUID is configured, and the UUID of the PPS application is selected within the range of the extended ID reserved by the Bluetooth protocol; During extended periodic broadcasting, the UUID of the PPS application is configured in the auxiliary broadcast indication packet (AUX_ADV_IND) to indicate the existence of the PPS application. After the existence of the PPS is indicated in an AUX_ADV_IND packet, the corresponding PPS content is configured in the auxiliary synchronization indication packet (AUX_SYNC_IND) following the AUX_ADV_IND packet; other UUIDs of standard Bluetooth BLE applications can also be configured in the AUX_ADV_IND packet to indicate the inclusion of other standard Bluetooth BLE applications; The PPS content includes PPS metadata (Metadata) and picture data. The PPS metadata (Metadata) is located in the auxiliary synchronization indication packet (AUX_SYNC_IND) packet, and the picture data is in the auxiliary synchronization indication packet (AUX_SYNC_IND) and / or the data packet of the auxiliary information chain (AUX_CHAIN_IND); The PPS metadata (Metadata) specifies the structure of the application data, and the PPS metadata (Metadata) includes a PPS metadata header field and a PPS metadata content field; The PPS metadata header field is used to indicate parameters such as the algorithm type, picture format, number of pictures, and frame rate of the picture; The PPS metadata content field includes parameters for indicating position offset, image size, color mode, resolution, shooting information, compression method, and bit depth. Among them, the PPS metadata content is configured as an array, and the number of elements in the array is related to the number of pictures. Each picture corresponds to its own PPS metadata content field. The position offset is used to indicate the position offset information of this picture within the group of periodic broadcasts. When there are multiple data packets within a periodic broadcast, the position offset is a two-dimensional coordinate, and the starting position of the picture data is obtained through this two-dimensional coordinate. The picture data can be dispersed within the payloads of multiple packets.

[0013] Furthermore, PPS provides a configuration interface, and PP configures it through the configuration interface provided by PPS. The state machine of PPS is configured to include an idle state (Idle), a configured state (Configured), and a periodic broadcast state (Broadcasting), and the state transformation is event-driven. There are multiple instructions corresponding to events, including: start instruction (Start), stop instruction (Stop), disable instruction (Disable), and configuration instruction (Configuration). These instructions are used to trigger the corresponding events to occur, causing the PPS state to transform. In addition, there is a reconfiguration instruction (Reconfiguration) corresponding to the Configured state, which is used for users to perform more refined parameter configuration. After the configuration is completed, PPS remains in the Configured state. And there is a metadata update instruction corresponding to the Broadcasting state, which is used to update the PPS metadata (Metadata) in the periodic broadcast state.

[0014] Furthermore, the steps for PP to configure PPS to start and end periodic broadcast transmission include: Initially, PPS is in the Idle state, and at this time, the wearable device is in the Idle state. Before taking a snapshot, trigger the configuration instruction (Configuration) through PP to configure PPS. After configuring the parameters according to the shooting parameters selected by the user, PPS enters the Configured state. After configuration, the start command Start is triggered to start the photographing and periodic broadcasting of the wearable device. At this time, the wearable device enters the Broadcasting state. In the Broadcasting state, the wearable device loops through the processes of taking pictures and sending periodic broadcasts, and simultaneously updates the PPS metadata; among them, in the Broadcasting state, when the user-triggered stop command Stop is collected, the wearable device can exit the Broadcasting state and re-enter the Configured state. At this time, the user can reset the parameters through the reconfiguration command Reconfiguration; When it is necessary to end the snapshot upload, the disable command Disable is triggered, and the wearable device enters the Idle state; among them, the disable command Disable can be triggered on the wearable device side or the first type of mobile device side. Regardless of whether the wearable device is in the Configured state or the Broadcasting state, after the disable command Disable is triggered, the wearable device will enter the Idle state.

[0015] Furthermore, in the Broadcasting state, the process of updating the PPS metadata is as follows: S101, calculate the number of pictures taken during the current periodic broadcast interval to obtain the total number of pictures M, where M is a natural number greater than 1, and M is less than or equal to the number of photos that the reserved memory of the wearable device can store; S102, calculate the memory size required for the PPS metadata and the picture data, and allocate memory; S103, fill the PPS metadata header; S104, plan the time points for each picture taking within the current periodic broadcast; S105, set the photo serial number N to 0, where N is an integer greater than or equal to 0; S106, wait for the start of picture taking. When the picture taking time point arrives, increment N by 1; S107, take a picture; S108, refine the PPS metadata content of the current snapshot and place it in the Nth serial number position of the array; S109, compress the snapshot data according to the configured compression algorithm, generate compressed picture data, and then place it in the corresponding Nth serial number position; S110, determine whether N is equal to M; if the determination is no, return to execute step S106; if the determination is yes, execute the following steps; S111, perform packet division on the data in the memory. Put the PPS metadata into the AUX_SYNC_IND packet, and disperse the data of M pictures into multiple AUX_CHAIN_IND packets; S112, according to the distribution of the picture data in the AUX_CHAIN_IND packets, modify the position offset information in the array elements corresponding to the content of the PPS metadata, so that the position offset information of the picture points to the correct picture data; S113, wait for the transmission anchor point of the periodic broadcast. When the transmission anchor point of the periodic broadcast arrives, send the PPS data; S114, after the transmission ends, release the memory and enter the next round of periodic broadcast, then return to execute step S101.

[0016] Furthermore, the second service BSCS provides corresponding control points for the periodic broadcast assistant Assistant to configure the periodic broadcast receiver Sink, so that the periodic broadcast receiver Sink can synchronize with the periodic broadcast source Source and parse the data sent by the periodic broadcast source Source. The steps are as follows: S201, provide the service number information Service UUID to the periodic broadcast receiver Sink to indicate which services are supported by the current periodic broadcast source Source; S202, provide the security information Security Info to the periodic broadcast receiver Sink to provide the key required to decode the data of the periodic broadcast source Source; S203, provide the physical layer information PHY Info to the periodic broadcast receiver Sink to indicate the physical layer protocol and rate-related parameters used by the periodic broadcast source Source to extend the periodic broadcast; S204, provide the periodic broadcast information PA Info to the periodic broadcast receiver Sink to indicate the relevant parameters for extending the periodic broadcast; S205, after the periodic broadcast receiver Sink receives the foregoing Service UUID, Security Info, PHY Info, and PA Info, start the synchronization process SYNC procedure to synchronize with the periodic broadcast source Source; Among them, the periodic broadcast receiver Sink and the periodic broadcast source end Source establish communication through an extended periodic broadcast link. At this time, the periodic broadcast receiver Sink is configured to: at the start point of the synchronization process, according to its clock deviation relative to the periodic broadcast source end Source, the next nearest periodic broadcast transmission anchor point of the periodic broadcast source end Source, and their respective clock jitter information, calculate the synchronization anchor point and the synchronization window. If the periodic broadcast source end Source cannot be synchronized within the calculated synchronization window, it is necessary to wait for the next period. Correspondingly, increase the time of the synchronization window to ensure that the periodic broadcast transmission anchor point of the next period can be synchronized subsequently.

[0017] The present invention also provides a communication system based on Bluetooth Low Energy (BLE), which includes a wearable device and at least one mobile device. The wearable device is configured to: as a periodic broadcast source end Source, when the time point of periodic broadcast arrives, broadcast image data through an extended periodic broadcast link; the extended periodic broadcast link is a Wi-Fi mode periodic broadcast extended based on the broadcast packet set in the BLE periodic broadcast by configuring the parameters of the broadcast packet, and the periodic broadcast transmission anchor point still follows the BLE protocol; the image data is sent out through the Wi-Fi mode periodic broadcast by using the relevant protocols of 802.11. The mobile device is configured to: as a periodic broadcast receiver Sink, after synchronizing with the periodic broadcast source device Source, periodically receive the data sent by the aforementioned periodic broadcast source device Source and parse the data.

[0018] Furthermore, the wearable device is a smart glasses. The mobile device is a mobile phone, a tablet computer, a smart power bank, and / or a smart glasses case, and the mobile device supports the extended BLE protocol through a Bluetooth adapter Dongle.

[0019] The present invention also provides a smart glasses, which includes a frame and an optical element held by the frame. A processor, a memory, a power supply, a camera, and a wireless communication module are arranged on the glasses, and the wireless communication module supports Bluetooth Low Energy (BLE) and Wi-Fi communication. The processor is configured to perform the following operations: when receiving the start instruction of the travel snapshot, enter the periodic broadcast state. In the periodic broadcast state, turn on the camera to take pictures to obtain image data and send a periodic broadcast. When the time point of the periodic broadcast arrives, broadcast the image data through an extended periodic broadcast link. The extended periodic broadcast link is a Wi-Fi mode periodic broadcast extended based on the broadcast packets set in the BLE periodic broadcast. The anchor point for periodic broadcast transmission still follows the BLE protocol. The image data is sent out through the Wi-Fi mode periodic broadcast using the relevant protocols of 802.11.

[0020] Due to the above technical solutions, compared with the prior art, the present invention has the following advantages and positive effects by way of example: Based on the extended BLE periodic broadcast (or periodic broadcast) technology provided in Chinese Patent Application CN202510281097.6, combined with the data transmission characteristics and requirements of wearable devices, a low-power and high-efficiency data transmission service is established on the extended periodic broadcast. Moreover, by further extending the BLE periodic broadcast, the switching between storage devices is not required to provide relevant services, thereby increasing the flexibility of data transmission and improving the system reliability. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 It is a communication network topology structure of the wearable device (taking smart glasses as an example) provided by the present invention and multiple mobile devices.

[0022] Figure 2 It is a communication link diagram of the periodic broadcast source end Source and the periodic broadcast sink end Sink, as well as the periodic broadcast assistant end Assistant and the periodic broadcast sink end Sink provided by the present invention.

[0023] Figure 3 It is a communication network topology structure constructed by the wearable device (taking smart glasses as an example) provided by the present invention and the first type of mobile device (taking a mobile phone as an example) and the second type of mobile device (taking a smart power bank and a smart glasses case as an example).

[0024] Figure 4 It is a schematic diagram of the protocol layer structure of the extended BLE GAP provided by the present invention.

[0025] Figure 5 It is the data content for expanding the AUX_ADV_IND packet to configure the PPS application provided by the present invention.

[0026] Figure 6 It is the data structure of the PPS application data provided by the present invention.

[0027] Figure 7 For Figure 6 The data structure after expanding the PPS application data in

[0028] Figure 8Communication link diagram of the PPS application provided by the present invention (taking smart glasses as an example) and the sub - specification SGPP (taking mobile phones as an example).

[0029] Figure 9 State machine schematic diagram of the PPS application provided by the present invention.

[0030] Figure 10 Device interaction schematic diagram of the operations of the user on the smart glasses, closing (Disable) the broadcast and snapshot taking in the Broadcasting state of the smart glasses provided by the present invention.

[0031] Figure 11 Device interaction schematic diagram of resetting the shooting parameters (i.e., reset) through the mobile phone provided by the present invention.

[0032] Figure 12 Device interaction schematic diagram of the whole process of the system from the Idle state to the Broadcasting state provided by the present invention.

[0033] Figure 13 Logic diagram of the metadata update process in the Broadcasting state provided by the present invention.

[0034] Figure 14 Communication link diagram of the periodic broadcast receiver Sink and the periodic broadcast source Source establishing communication through the periodic broadcast assistant Assistant provided by the present invention.

[0035] Figure 15 Device interaction schematic diagram of configuring the periodic broadcast receiver Sink through the periodic broadcast assistant Assistant to synchronize with the periodic broadcast source Source provided by the present invention.

[0036] Figure 16 Transmission timing diagram of the periodic broadcast receiver Sink synchronizing the periodic broadcast transmission anchor point of the periodic broadcast source Source by calculating the SYNC anchor point and SYNC window provided by the present invention. Detailed implementation manners

[0037] The following further elaborates on the data transmission method, communication system, and smart glasses based on Bluetooth Low Energy (BLE) disclosed in the present invention in conjunction with the accompanying drawings and specific embodiments. It should be noted that technologies (including methods and devices) known to those of ordinary skill in the relevant fields may not be discussed in detail, but in appropriate cases, the above-known technologies are regarded as part of the specification. At the same time, other examples of the exemplary embodiments may have different values. The structures, ratios, sizes, etc. depicted in the drawings of this specification are only used to cooperate with the content disclosed in the specification for those familiar with this technology to understand and read, and are not used to limit the limiting conditions under which the invention can be implemented. In the description of the embodiments of the present application, " / " means "or", and "and / or" is used to describe the association relationship of associated objects, indicating that there can be three relationships. For example, "A and / or B" means: A exists alone, B exists alone, and both A and B exist at the same time. In the description of the embodiments of the present application, "a plurality of" means two or more, and "multiple levels" means two levels or more.

[0038] Technical term explanations: 1) BLE Periodic Advertising: Also known as BLE periodic broadcast, it is an important function introduced in Bluetooth 5.0, mainly used for efficient data transmission between Bluetooth Low Energy (BLE) devices. As a broadcast mechanism in the Bluetooth Low Energy specification, Periodic Advertising (PA) allows the broadcast device to continuously broadcast data at fixed time intervals, and the accessing Bluetooth device can receive data at each broadcast interval after the synchronization is established. Periodic broadcast is suitable for scenarios that require continuous and low-power data transmission, such as sensor data, audio data, etc., and is of great significance for achieving stable and reliable data transmission.

[0039] 2) BLE GAP (i.e., BLE Generic Access Profile): The full name of GAP is Generic Access Profile. BLE GAP is the top layer in the BLE protocol stack, which defines how devices discover each other, establish connections, and implement binding, as well as how devices become broadcast endpoints and receiving endpoints (roles), and implement connectionless data transmission; it also defines different types of addresses to achieve privacy and resolvability.

[0040] 3) Bluetooth adapter Dongle: A Dongle is a hardware device that can be connected to the device for the purpose of accessing software applications, services, and / or data, etc., to provide additional functions to the device. Some functions on the device can be simply enabled by connecting the Dongle to the device. In the present invention, the Bluetooth module on the Bluetooth adapter Dongle supports the extended Bluetooth Low Energy (BLE) protocol. The extended Bluetooth Low Energy (BLE) protocol is based on the broadcast packets set in the existing BLE periodic advertisement PA, and extends the periodic broadcast transmission related to Wi-Fi by configuring the parameters in the broadcast packets. The periodic broadcast transmission anchor point still follows the BLE protocol specification; after extension, the periodic broadcast has a Wi-Fi mode and a BLE mode. In the Wi-Fi mode, Wi-Fi periodic broadcasts are transmitted based on the aforementioned configured parameters; in the BLE mode, standard BLE periodic broadcasts are transmitted. Embodiment

[0041] This embodiment provides a data transmission method based on Bluetooth Low Energy (BLE) for communication between a wearable device and a mobile device (or portable device).

[0042] Specifically, the method communicates between the wearable device and the mobile device through an extended periodic broadcast link to transmit image data from the wearable device to the mobile device. In the periodic broadcast mode, the wearable device is the periodic broadcast source end Source, and the mobile device is the periodic broadcast receiving end Sink.

[0043] The mobile device can be one or more, that is, the periodic broadcast receiving end Sink can be one device or multiple devices. In practical applications, users can select one or more mobile devices according to their needs for data storage.

[0044] The extended periodic broadcast link is a Wi-Fi mode periodic broadcast extended by configuring the parameters of the broadcast packet based on the broadcast packet set in the BLE periodic broadcast. The periodic broadcast transmission anchor point still follows the BLE protocol specification. The image data is sent out using the relevant protocols of 802.11 through the Wi-Fi mode periodic broadcast.

[0045] The periodic broadcast in Wi-Fi mode is a periodic broadcast obtained by expanding and configuring the existing BLE periodic broadcast, which can be sent using the physical layer related to Wi-Fi (corresponding to the 802.11 protocol), and it can enhance the BLE periodic broadcast rate. The expansion includes: based on the broadcast packet set in the BLE periodic broadcast, expanding the periodic broadcast transmission related to Wi-Fi by configuring the parameters of the auxiliary pointer AuxPtr field and the synchronization information SynInfo field in the extended broadcast indication packet ADV_EXT_IND packet and the auxiliary broadcast indication packet AUX_ADV_IND packet. The periodic broadcast transmission anchor point still follows the BLE protocol specification. After expansion, the periodic broadcast has Wi-Fi mode and BLE mode. In Wi-Fi mode, Wi-Fi periodic broadcast is transmitted based on the aforementioned configured parameters; in BLE mode, standard BLE periodic broadcast is transmitted.

[0046] In specific implementation, first, expand the parameters of the AUX PHY field AuxPtr.PHY in the AuxPtr field to configure the Wi-Fi related physical layer Wi-Fi PHY, so as to indicate that the periodic broadcast is sent using the physical layer related to Wi-Fi (corresponding to the 802.11 related protocol). By expanding the AuxPtr field, the PHY with Wi-Fi as the physical layer is specified, and the periodic broadcast transmission anchor point still follows the BLE protocol specification.

[0047] Secondly, configure the Wi-Fi transmission channel by expanding the SyncInfo field. Specifically, when configuring the Wi-Fi transmission channel, the original SyncInfo.ChM field can be divided into two sub-fields, including the first sub-field and the second sub-field. After dividing the 37-bit width corresponding to the original SyncInfo.ChM field into two parts, they are respectively assigned to the aforementioned first sub-field and second sub-field. The first sub-field can be multiple bits at the front of the 37-bit field, used to encode the channels of Wi-Fi in the 2.4 GHz or 5 GHz frequency band to indicate the Wi-Fi transmission channel. The second sub-field is the remaining bits at the back, used to encode the specific Wi-Fi PHY type to indicate the specific protocol type of Wi-Fi.

[0048] Then, configure the number of Wi-Fi data packets by expanding the parameters of the PeriodicEventCounter field in the SyncInfo field to specify the number of Wi-Fi data packets to be sent in the periodic broadcast in Wi-Fi mode.

[0049] For the specific implementation of extending the periodic broadcast of BLE to use Wi-Fi (corresponding to the 802.11 related protocol) to send periodic broadcasts, refer to the relevant records in the patent application CN202510281097.6, which will not be elaborated here.

[0050] The present invention is a further improvement based on the above technologies. Based on the technologies provided by the above basic patent, a low-power and high-efficiency data transmission service is established thereon.

[0051] For ease of description, the following takes a smart glasses as a wearable device as an example to describe in detail the specific implementation manner of this embodiment.

[0052] See Figure 1 As shown, a topological network of a smart glasses communicating with three mobile devices through extended periodic broadcasts is exemplified. The three mobile devices are a mobile phone, a smart power bank, and a battery-equipped smart glasses case.

[0053] The smart glasses, as the source end (Broadcast Source) of the extended periodic broadcast, will broadcast the snapshot packed and compressed in the retention memory through the extended periodic broadcast link in the basic patent. In practical applications, one or two mobile devices can be optionally selected for data reception. According to the power consumption strategy, the broadcast can choose to retransmit or not retransmit.

[0054] The mobile phone, the smart power bank, and / or the battery-equipped smart glasses case serve as the receiving end (Broadcast Sink) of the extended periodic broadcast. After passing the relevant security authentication, they can correctly parse the data of the Broadcast Source.

[0055] In this embodiment, the smart glasses have a travel snapshot function, which can be used by the user to take travel snapshots. Preferably, the smart glasses are configured to: compress and package multiple consecutive snapshots according to the capacity of its own retention memory to form an image data set; and when the periodic broadcast arrives, send the image data set through the periodic broadcast in the Wi-Fi mode at one time. Compared with the existing strategy of sending each snapshot separately, such a sending strategy can effectively reduce the radio frequency overhead of the device.

[0056] At this time, the period interval of the periodic broadcast can be configured in combination with the reserved memory and the photographing interval of the device, so that when the sending anchor point of the periodic broadcast arrives, a preset number of snapshots can be broadcast at one time. By way of example and not limitation, for instance, if the device is configured to take one photo per second and the current Retention Memory can store up to 10 photos at most, the period interval of the periodic broadcast can be set to 10 seconds. At this time, the image data set formed by packing 10 photos is sent out at one time.

[0057] In this embodiment, the mobile device as the periodic broadcast receiver (Broadcast Sink) can be a mobile phone, or a smart power bank with storage function, or a smart glasses case with a battery, which is used to save data from the glasses. The above mobile device can support the extended BLE protocol through a Bluetooth adapter Dongle.

[0058] When there are multiple mobile devices, the data receiving strategy of the mobile devices can be configured in one of the following ways.

[0059] Way a: Select one mobile device from multiple mobile devices as the periodic broadcast receiver Sink. When the current periodic broadcast receiver Sink cannot receive broadcast data normally, select another mobile device from the above multiple mobile devices as the periodic broadcast receiver Sink to continue receiving broadcast data.

[0060] Way b: Select multiple mobile devices as the periodic broadcast receiver Sink to receive broadcast data simultaneously. At this time, the broadcast data is configured in a non-retransmission mode.

[0061] Compared with a single mobile device, the advantage of multiple mobile devices is that power consumption balance can be achieved between devices. For example, when the mobile phone is running out of power, other mobile devices can be turned on to continue receiving data, providing the reliability of data transmission. Further, when multiple devices receive simultaneously, the broadcast data can be configured in a non-retransmission mode, which can improve the reception success rate while reducing power consumption. In addition, offline data recovery can be achieved through some existing algorithms.

[0062] In another implementation manner of this embodiment, considering the functions designed for different mobile devices, based on the existing Bluetooth BLE specification, the roles (Role) participating in the periodic broadcast communication are also extended, and a communication network topology structure including a periodic broadcast source end Source, a periodic broadcast receiver end Sink, and a periodic broadcast assistant end Assistant is proposed.

[0063] The periodic broadcast source end, Source, as the origin of broadcast data, needs to send data with as small an overhead (power consumption) as possible. In this embodiment, the periodic broadcast source end can, after receiving a snapshot instruction from the user, turn on the interval transmission mode of taking pictures and periodic broadcasting without knowing the existence of the periodic broadcast sink end, Sink.

[0064] The periodic broadcast sink end, Sink, is used to periodically receive data from Source, save it, and perform corresponding processing. Since it may not have a human-machine interface such as a display screen or buttons (such as the intelligent power bank in the figure), the Assistant end needs to assist in searching for Source (intelligent glasses) and perform corresponding security authentication for parsing the data.

[0065] The periodic broadcast assistant end, Assistant, is usually a device with a display and rich I / O - such as a mobile phone, which can assist Sink in synchronizing with Source. The Assistant and Sink can communicate bidirectionally, as shown in Figure 2 shown.

[0066] In this embodiment, when the Assistant end and the Sink end are different devices, they communicate via a BLE link, as shown in Figure 3 shown. When a device serves as both the Assistant end and the Sink end, the Assistant end and the Sink end directly perform internal interactions, such as the mobile phone in Figure 3 shown.

[0067] For the above scenario, this embodiment classifies mobile devices into the first type of mobile devices and the second type of mobile devices.

[0068] The first type of mobile devices are usually devices with a human-machine interaction interface, and this device can simultaneously serve as the periodic broadcast sink end, Sink, and the periodic broadcast assistant end, Assistant.

[0069] The second type of mobile devices are usually devices without a human-machine interaction interface, and this device can usually only serve as the periodic broadcast sink end, Sink.

[0070] The first type of mobile devices are configured to: as the periodic broadcast sink end, Sink, periodically receive data from the periodic broadcast source end, Source, save it, and perform corresponding processing; and, as the periodic broadcast assistant end, Assistant, assist the second type of mobile devices in further synchronizing with the periodic broadcast source end, Source. At this time, the first type of mobile devices and the second type of mobile devices communicate bidirectionally via a BLE link.

[0071] The second type of mobile device needs to use the first type of mobile device as a periodic broadcast assistant, Assistant, to assist in searching for a periodic broadcast source, Source, and perform corresponding security authentication to parse the data. The second type of mobile device is configured to: as a periodic broadcast receiver, Sink, communicate with the periodic broadcast assistant, Assistant, via a BLE link to obtain the parameters required for synchronizing with the periodic broadcast source, Source, and, after synchronizing with the periodic broadcast source, Source, periodically receive the data of the periodic broadcast source, Source, save it, and perform corresponding processing.

[0072] For the snapshot transmission function of smart glasses, the present invention further extends the BLE protocol. Specifically, the Generic Access Profile (GAP) of the BLE protocol is extended, and two new services and one sub-profile are added on the original protocol layer. In the Bluetooth protocol, each specific Bluetooth application can be composed of multiple services. The Bluetooth protocol contains many sub-profiles. A profile is the protocol stack corresponding to each specific application scenario and each type of application in Bluetooth. It can be understood that a profile is a combination of protocols from bottom to top corresponding to the implementation of a certain function.

[0073] Specifically, the present invention adds two services, PPS and BSCS, and a sub-profile for managing the aforementioned PPS and BSCS on the original protocol layer.

[0074] The first service, PPS, is a service related to picture publishing (Published Picture Service), the second service, BSCS, is a service related to broadcast source configuration (Broadcast Source Configuration Service), and the sub-profile is a specification related to picture transmission of wearable devices, PP (Picture Profile). Specifically, when the wearable device is a smart glass, the sub-profile is a specification related to picture transmission of smart glasses, that is, SGPP (Smart Glass Picture Profile). The above specifications are for implementing the picture transmission function of smart glasses.

[0075] The first service, PPS, and the second service, BSCS, are parallel and independent service layers, both located above the GATT (Generic Attribute Profile, which is a sub-profile for generalizing / abstracting data, that is, a regulation for logically expressing data.) layer. The sub-profile, SGPP, is based on the PPS and BSCS services and is located above the PPS and BSCS layers. SeeFigure 4 as shown

[0076] The functions of the first service, the second service, and the sub - specification are as follows: The first service, PPS, runs on the smart glasses which act as the source of the periodic broadcast (Source), and is used to indicate the structure and configuration information of the current data stream through broadcasting.

[0077] The second service, BSCS, runs on the mobile device which acts as the sink of the periodic broadcast. Among them, for the first - type mobile devices, when they act as the assistant of the periodic broadcast (Assistant), other periodic - broadcast sinks are configured to synchronize with the periodic - broadcast source (Source) through the BSCS.

[0078] The sub - specification SGPP runs on the smart glasses or the mobile phone (the first - type mobile device) and is used to manage PPS and BSCS. When the sub - specification SGPP runs on the mobile phone (the first - type mobile device), the mobile phone communicates with the smart glasses through the BLE link to configure the PPS running on the smart glasses.

[0079] In this embodiment, the position of the PPS application data in the broadcast is configured. Specifically, a service number UUID is configured corresponding to the PPS. Like other UUIDs of the BLE application, the PPS UUID can be 16 - bit or 128 - bit, and it is sent through the Auxiliary Broadcast Indication Packet (AUX_ADV_IND), see Figure 5 as shown. The UUID of PPS is selected within the extended ID range reserved by the Bluetooth protocol, and users can define it according to the Bluetooth protocol rules.

[0080] That is to say, during the extended periodic broadcast, the UUID of the PPS application can be configured in the Auxiliary Broadcast Indication Packet (AUX_ADV_IND) to indicate the existence of the PPS application. After the existence of the PPS is indicated in an AUX_ADV_IND packet, the corresponding PPS content is configured in the Auxiliary Synchronization Indication Packet (AUX_SYNC_IND) following the AUX_ADV_IND packet.

[0081] In addition to including the UUID of PPS, other UUIDs of standard Bluetooth BLE applications can also be configured in the AUX_ADV_IND packet (to indicate that other standard Bluetooth BLE applications are also included), see Figure 5 as shown: Because in addition to the application scenarios of the present invention, the smart glasses may also include other standard Bluetooth BLE applications.

[0082] It should be noted that, different from standard Bluetooth BLE applications, after the existence of PPS is specified in AUX_ADV_IND, its content is in the subsequent Auxiliary Synchronization Indication Packet (AUX_SYNC_IND). Arranging the PPS content in the AUX_SYNC_IND packet rather than the AUX_ADV_IND packet is because after the Sink synchronizes with the Source, it is not necessary to receive the ADV_EXT_IND and AUX_ADV_IND in front of the periodic broadcast transmission anchor point every time, but can directly receive the AUX_SYNC_IND and subsequent packets.

[0083] In this embodiment, the PPS content may include PPS metadata and picture data. The PPS metadata is located in the Auxiliary Synchronization Indication Packet (AUX_SYNC_IND), and the picture data may be in the Auxiliary Synchronization Indication Packet (AUX_SYNC_IND) and / or in the data packet of the Auxiliary Information Chain (AUX_CHAIN_IND).

[0084] The PPS metadata specifies the structure of the SGPP application data. Specifically, the PPS metadata may include two parts: a data header and data content, that is, Figure 6 the PPS metadata header and PPS metadata content in, and the picture data is located behind the PPS metadata content field.

[0085] The PPS metadata header field is used to indicate parameters such as the algorithm type, picture format, number of pictures, and frame rate of the picture.

[0086] The algorithm type is used to indicate whether the compression type of the picture is a lossy compression type or a lossless compression type. The picture format is used to indicate the picture format of the currently transmitted image. Different picture formats correspond to different compression algorithms. For example, the compression algorithms may include JPEG, MPEG, PNG, etc. The number of pictures is used to indicate the number of pictures transmitted in this periodic broadcast. The frame rate is used to indicate the frame rate calculated from the number of pictures transmitted in this period.

[0087] The PPS metadata content field includes parameters for indicating position offset, image size, color mode, resolution, shooting information, compression method, and bit depth.

[0088] The position offset is used to indicate the position offset information of this picture within the group of periodic broadcasts, and specifically may include two coordinate positions, respectively representing which packet of the group of periodic broadcasts the picture is in and the offset within the packet. The image size is used to indicate the byte size of the image, with the unit being byte. The color mode, by way of example and not limitation, may be RGB, RGBA, CMYK, etc. The shooting information includes, but is not limited to, information such as the camera model, shooting date, time, aperture, shutter speed, sensitivity, etc. The compression method is used to indicate the specific coding method adopted for image compression, such as DEFLATE, RLE (Run-Length Encoding), etc. The bit depth is used to indicate the number of color bits per pixel, such as 1 bit (black and white image), 8 bits (256-color image), 24 bits (true color image), etc.

[0089] Among them, the PPS metadata content is configured as an array, and the number of elements in the array is related to the number of pictures (that is, the number of elements in the array is specified by the number of pictures), and each picture corresponds to its own PPS metadata content field. Figure 6 For the data structure of the PPS metadata, after expansion, it becomes Figure 7 as shown.

[0090] In addition, since a periodic broadcast may be composed of multiple data packets internally, the position offset is configured as a two-dimensional coordinate, and through this two-dimensional coordinate, the starting position of the picture data can be found. The picture data can be scattered within the payloads of multiple packets.

[0091] In this embodiment, the PPS application provides a configuration interface, and the SGPP configures it through the interface provided by the PPS. When designing the product, there are two options: the first is to directly configure it through the voice control and projection display of the smart glasses; the second is to connect through a mobile phone and use the rich human-computer interaction interface of the mobile phone for configuration. See Figure 8 as shown, the mobile phone where the SGPP is located connects to the smart glasses where the PPS is located through BLE and configures the PPS through the BLE link.

[0092] Specifically, the state machine of the PPS is configured to include an idle state (Idle), a configured state (Configured), and a periodic broadcast state (Broadcasting), and the state transformation is driven by events.

[0093] See Figure 9As shown, multiple instructions can be set for corresponding events, including: Start instruction Start, Stop instruction Stop, Disable instruction Disable, and Configuration instruction Configuration. By these instructions, corresponding events are triggered to occur, causing the PPS state to change; and, a Reconfiguration instruction set for the Configured state, which is used for users to perform more refined parameter configuration. After the configuration is completed, the PPS remains in the Configured state; and, a metadata update instruction set for the Broadcasting state, which is used to update the PPS metadata Metadata in the periodic broadcast state.

[0094] At this time, the typical steps for the SGPP to configure the PPS and start and end the periodic broadcast transmission can be as follows: Initially, the PPS is in the Idle state, and at this time, the smart glasses are in the Idle state.

[0095] Before taking a snapshot, the PPS is configured by triggering the Configuration instruction through the SGPP. After the parameters are configured according to the shooting parameters selected by the user, the PPS enters the Configured state. That is, the shooting parameters desired by the user are set. The shooting parameters can specifically include shooting frequency (i.e., frame rate, shooting once every 1 second, 2 seconds, 3 seconds...), shooting mode, focus option, exposure compensation, white balance and other parameters. At this time, if the user needs to perform more refined parameter configuration, it can be done by triggering the Reconfiguration instruction. After completion, the PPS remains in the Configured state.

[0096] After the configuration is completed, triggering the Start instruction can start the photo taking and periodic broadcast of the smart glasses. At this time, the smart glasses enter the Broadcasting state. In the Broadcasting state, the smart glasses cycle through the processes of taking photos and sending periodic broadcasts, and at the same time update the PPS metadata Metadata. Among them, in the Broadcasting state, when the user triggers the Stop instruction, the smart glasses can exit the Broadcasting state and re-enter the Configured state. At this time, the user can reset the parameters through the Reconfiguration instruction.

[0097] When it is necessary to end the snapshot upload, the shutdown instruction Disable is triggered, and the smart glasses enter the Idle state. Among them, the shutdown instruction Disable can be triggered on the smart glasses side or the first type of mobile device side. Regardless of whether the smart glasses are in the Configured state or the Broadcasting state, after the shutdown instruction Disable is triggered, the smart glasses will enter the Idle state.

[0098] Figures 10 to 12 Several typical application scenarios are exemplified.

[0099] Among them, Figure 10 For the smart glasses in the Broadcasting state, the operations of the user on the glasses. For example, the user can end the periodic broadcast and snapshot shooting by triggering the shutdown instruction Disable, causing the glasses to enter the Idle state.

[0100] Figure 11 For the smart glasses in the Broadcasting state, the operation process for the user to reset the shooting parameters through the mobile phone. Specifically, initially, when the smart glasses are in the Broadcasting state and it is necessary to reset the parameters, the user can trigger the stop instruction Stop through the mobile phone. After the smart glasses receive the above instruction, they can exit the Broadcasting state and enter the Configured state. At this time, the user then triggers the reconfiguration instruction Reconfiguration through the mobile phone to reset the parameters. After the parameter configuration is completed, the smart glasses send a configuration confirmation message to the mobile phone, and then the user can trigger the start instruction Start through the mobile phone to start the photo taking and periodic broadcast of the smart glasses. After the smart glasses send a confirmation message to the mobile phone, they enter the Broadcasting state.

[0101] Figure 12This is the entire process of the system from the Idle state to broadcasting. Initially, the smart glasses are in the Idle state. Before taking a snapshot, the PPS can be configured by triggering the configuration instruction Configuration through the mobile phone. After configuring the parameters according to the shooting parameters selected by the user, the smart glasses send a confirmation message to the mobile phone, and the PPS enters the Configured state. At this time, if the user needs to perform more refined parameter configuration, it can be done by triggering the Reconfiguration instruction. After the configuration is completed, the smart glasses send a confirmation message to the mobile phone, and the PPS remains in the Configured state. After the reconfiguration is completed, the user can trigger the start instruction Start through the mobile phone to turn on the photo taking and periodic broadcasting of the smart glasses. After the smart glasses send a confirmation message to the mobile phone, they enter the Broadcasting state. In the Broadcasting state, the smart glasses cycle through the processes of taking pictures and sending periodic broadcasts, and at the same time update the PPS metadata Metadata.

[0102] In the Broadcasting state, if the user triggers the disable instruction Disable, the smart glasses enter the Idle state; if it is detected that the user triggers the stop instruction Stop, the smart glasses can exit the Broadcasting state and re-enter the Configured state. At this time, the user can reset the parameters through the reset instruction Reconfiguration.

[0103] In addition, it should be noted that in the Broadcasting state, the metadata update procedure Metadata UpdateProcedure is a periodic activity until the system exits the Broadcasting state.

[0104] Participate Figure 13 As shown, the specific steps for updating the PPS metadata Metadata in the Broadcasting state are exemplified as follows: S101, calculate the number of times of taking pictures within the current periodic broadcast interval to obtain the total number of pictures M, where M is a natural number greater than 1, and M is less than or equal to the number of photos that can be stored in the reserved memory of the wearable device.

[0105] S102, calculate the memory size required for the PPS metadata and the picture data, and allocate memory.

[0106] S103, fill the PPS metadata header.

[0107] S104, plan the time points for each photo taking within the current periodic broadcast.

[0108] S105, Set the photo serial number N to 0, where N is an integer greater than or equal to 0.

[0109] S106, Wait for the start of taking pictures. When the time point for taking pictures arrives, increment N by 1.

[0110] S107, Take pictures.

[0111] S108, Refine the PPS metadata content for the current snapshot and place it at the Nth position in the array.

[0112] S109, Compress the snapshot data according to the configured compression algorithm. After generating the compressed image data, place it at the corresponding Nth position.

[0113] S110, Determine whether N is equal to M. If the determination is no, return to execute step S106. If the determination is yes, execute the following steps.

[0114] S111, Perform packet division on the data in the memory. Put the PPS metadata (Metadata) into the AUX_SYNC_IND packet, and disperse the M image data into multiple AUX_CHAIN_IND packets.

[0115] S112, According to the distribution of the image data in the AUX_CHAIN_IND packets, modify the position offset information in the corresponding array elements of the PPS metadata content so that the position offset information of the image points to the correct image data. Since the image data is dispersed in multiple AUX_CHAIN_IND packets, after the image collection is completed, it is necessary to calculate the position offset in the metadata content sequentially according to the sub-packet situation so that the position offset information points to the correct image data.

[0116] S113, Wait for the transmission anchor point of the periodic broadcast. When the transmission anchor point of the periodic broadcast arrives, send the PPS data.

[0117] S114, The transmission ends, release the memory, enter the next round of periodic broadcast, and return to execute step S101.

[0118] The above solution extends the periodic broadcast and uses the relevant protocols of 802.11 to send the image data, enabling the data to be transmitted quickly, thereby being able to shorten the on-time of the radio frequency circuit as much as possible to reduce the power consumption of the device.

[0119] In this embodiment, the second service BSCS provides the corresponding control point (Control Point) for the periodic broadcast assistant (Assistant) to configure the periodic broadcast receiver (Sink), so that the periodic broadcast receiver (Sink) can synchronize with the periodic broadcast source (Source) and parse the data sent by the periodic broadcast source (Source), seeFigure 14 as shown

[0120] See Figure 15 As shown, the specific steps to synchronize the periodic broadcast receiver Sink with the periodic broadcast source Source in the previous cycle are roughly divided into 5 steps as follows: S201. Provide the service number information Service UUID to the periodic broadcast receiver Sink to indicate which services the current periodic broadcast source Source supports.

[0121] S202. Provide the security information Security Info to the periodic broadcast receiver Sink to provide the key required to decode the data of the periodic broadcast source Source.

[0122] S203. Provide the physical layer information PHY Info to the periodic broadcast receiver Sink to indicate the physical layer protocol, rate and other related parameters used by the periodic broadcast source Source to extend the periodic broadcast.

[0123] S204. Provide the periodic broadcast information PA (Periodic Advertising )Info to the periodic broadcast receiver Sink to indicate the relevant parameters for extending the periodic broadcast. As an example, parameters such as the broadcast period, hopping sequence, clock and its accuracy, Bluetooth address and type are included.

[0124] S205. After receiving the foregoing Service UUID, Security Info, PHY Info and PA Info information, the periodic broadcast receiver Sink starts the synchronization process SYNC procedure to synchronize with the periodic broadcast source Source in the previous cycle.

[0125] In this embodiment, when the periodic broadcast receiver Sink and the periodic broadcast source Source establish communication through an extended periodic broadcast link, the periodic broadcast receiver Sink is configured to: at the start point of the synchronization process (i.e., SYNC procedure), according to its clock deviation relative to the periodic broadcast source Source, the next nearest periodic broadcast transmission anchor point of the periodic broadcast source Source, and their respective clock jitter information, calculate the synchronization anchor point (i.e., the SYNC anchor point in Figure 16 and the synchronization window (i.e., the SYNC window in Figure 16 . If the periodic broadcast source Source cannot be synchronized within the calculated synchronization window, it is necessary to wait for the next cycle. Correspondingly, increase the time of the synchronization window to ensure that the periodic broadcast transmission anchor point of the next cycle can be synchronized subsequently. See Figure 16 as shown, the calculated SYNC anchor point fails to synchronize with Figure 16The first cycle broadcasts and sends the anchor point, so it is necessary to wait for the next cycle to broadcast and send the anchor point. Correspondingly, the time of the SYNC window needs to be extended to cover the time point of the next cycle to broadcast and send the anchor point ( Figure 16 the second cycle in which the anchor point is broadcast and sent) so as to be able to receive the data broadcast by the cycle broadcast source end Source in this cycle. Figure 16 In, the start point of the SYNC process corresponds to Figure 15 the start point of the SYNC procedure in the 5th step in; when the cycle broadcast receiver Sink synchronizes with the cycle broadcast source end Source, the SYNC window can successfully receive the first packet ( Figure 16 the first packet sent by Source after the second cycle broadcast anchor point in).

[0126] Another embodiment of the present invention further provides a communication system based on low-power Bluetooth BLE. The system includes a wearable device and at least one mobile device.

[0127] The wearable device is configured to: as a cycle broadcast source end Source, when the time point of the cycle broadcast arrives, broadcast the image data through an extended cycle broadcast link; the extended cycle broadcast link is a cycle broadcast in Wi-Fi mode extended based on the broadcast packet set in the BLE cycle broadcast by configuring the parameters of the broadcast packet, and the cycle broadcast anchor point still follows the BLE protocol specification; the image data is sent out through the cycle broadcast in Wi-Fi mode using the relevant protocols of 802.11.

[0128] The mobile device is configured to: as a cycle broadcast receiver Sink, after synchronizing with the cycle broadcast source device Source, periodically receive the data sent by the aforementioned cycle broadcast source device Source and parse the data.

[0129] In this embodiment, the wearable device is preferably a smart glasses.

[0130] The mobile device is preferably a mobile phone, a tablet computer, a smart power bank and / or a smart glasses case, and the mobile device supports the extended BLE protocol through a Bluetooth adapter Dongle.

[0131] For other technical features, refer to the description of the previous embodiment, and details are not described herein again.

[0132] Another embodiment of the present invention further provides a smart glasses.

[0133] The smart glasses include a frame and optical elements held by the frame. A processor, a memory, a power supply, a camera, and a wireless communication module are provided on the glasses. The wireless communication module supports Bluetooth Low Energy (BLE) and Wi-Fi communications.

[0134] The processor is configured to perform the following operations: when receiving a start instruction for a trip snapshot, enter a periodic broadcast state. In the periodic broadcast state, turn on the camera to take pictures to obtain image data and send periodic broadcasts. When the time point of the periodic broadcast arrives, broadcast the image data through an extended periodic broadcast link.

[0135] The extended periodic broadcast link is a Wi-Fi mode periodic broadcast extended based on the broadcast packets set in the BLE periodic broadcast by configuring the parameters of the broadcast packets. The anchor point for sending the periodic broadcast still follows the BLE protocol. The image data is sent out through the Wi-Fi mode periodic broadcast using the relevant protocols of 802.11.

[0136] For other technical features, refer to the description of the previous embodiments and will not be elaborated here.

[0137] In the above description, the disclosure of the present invention is not intended to limit itself to these aspects. Instead, within the scope of the object protection of this disclosure, the components can be selectively and operably combined in any number. Additionally, terms such as "including", "comprising", and "having" should be construed as inclusive or open by default, rather than exclusive or closed, unless it is explicitly defined to have the opposite meaning. All technical, scientific, or other terms conform to the meaning understood by those skilled in the art, unless it is defined to have the opposite meaning. Common terms found in the dictionary should not be interpreted too idealistically or too unrealistically in the context of the relevant technical documents, unless this disclosure explicitly defines it as such. Any changes or modifications made by those of ordinary skill in the art of the present invention based on the above disclosure fall within the protection scope of the claims.

Claims

1. A data transmission method based on low-power Bluetooth BLE, used for communication between a wearable device and a mobile device, characterized in that: Communicating between the wearable device and the mobile device via an extended periodic broadcast link to transmit image data from the wearable device to the mobile device, the wearable device being a periodic broadcast source Source, and the mobile device being a periodic broadcast sink; The extended periodic broadcast link is based on the broadcast packet set in the BLE periodic broadcast, and is a periodic broadcast of the Wi-Fi mode extended by configuring the parameters of the broadcast packet. The periodic broadcast sending anchor point is still specified according to the BLE protocol; the image data is sent out through the periodic broadcast of the Wi-Fi mode using the relevant 802.11 protocol.

2. The method according to claim 1, characterized in that The wearable device is a smart glasses, which is used to take a snapshot of the trip and form an image data set including a plurality of snapshots of the trip; The smart glasses are configured to: compress and package multiple consecutive snapshots to form the image data set according to the size of their own memory capacity; and send the image data set out at one time through the periodic broadcast of the Wi-Fi mode when the periodic broadcast arrives.

3. The method according to claim 1, characterized in that The mobile device is one or more. When the mobile device is multiple, the data receiving strategy of the mobile device is configured as: a. Selecting one mobile device from multiple mobile devices as a periodic broadcast receiving end Sink. When the current periodic broadcast receiving end Sink cannot normally receive the broadcast data, selecting another mobile device from the aforementioned multiple mobile devices as a periodic broadcast receiving end Sink to continue receiving the broadcast data; or b. Selecting multiple mobile devices as periodic broadcast receiving end Sinks to receive the broadcast data simultaneously. At this time, the broadcast data is configured as a non-retransmission mode.

4. The method according to any one of claims 1 to 3, characterized in that When there are multiple mobile devices, they include a first type of mobile device and a second type of mobile device; The first type of mobile device is a device with a human-computer interaction interface, which is configured to: act as a periodic broadcast receiving end Sink, periodically receive data from a periodic broadcast source Source, save and process accordingly; and act as a periodic broadcast assistant Assistant, assisting the second type of mobile device to synchronize with the periodic broadcast source Source, at which time, the first type of mobile device and the second type of mobile device communicate bidirectionally via a BLE link; The second type of mobile device is a device without a human-computer interaction interface, which needs to use the first type of mobile device as a periodic broadcast assistant to assist in searching for the periodic broadcast source Source and pass the corresponding security authentication to parse the data; The second type of mobile device is configured to: act as a periodic broadcast receiving end Sink, communicate with the periodic broadcast assistant end Assistant through a BLE link to obtain the parameters required for synchronizing the periodic broadcast source end Source, and, after synchronizing the periodic broadcast source end Source, periodically receive the data of the periodic broadcast source end Source, save it and perform corresponding processing.

5. The method according to claim 4, characterized in that The general access profile GAP of the BLE protocol is expanded, and two new services Service and a sub-profile Profile for managing the two services are added on the original protocol layer; wherein the first service is the service PPS related to picture publishing, and the second service is the service BSCS related to broadcast source configuration, and the sub-profile is the profile PP related to wearable device picture transmission; the two services are parallel and independent service layers, both located on the upper layer of the GATT layer; the sub-profile is based on the two services and located on the upper layer of the two service layers; The first service runs on a wearable device that is a periodic broadcast source, and is used to indicate the structure and configuration information of the current data stream through broadcasting; The second service runs on a mobile device that serves as a periodic broadcast receiving end Sink. For the first type of mobile device, when it serves as a periodic broadcast assistant, the second service is used to configure other periodic broadcast receiving ends Sink to synchronize with the periodic broadcast source end Source; The sub-specification runs on the wearable device or on the first type of mobile device. When the sub-specification runs on the first type of mobile device, the first type of mobile device communicates with the wearable device through a BLE link to configure the first service running on the wearable device.

6. The method according to claim 5, characterized in that Corresponding to the first service PPS, a corresponding service number UUID is configured, and the UUID of the PPS application is selected within the extended ID range reserved by the Bluetooth protocol; During extended periodic broadcasting, the UUID of the PPS application is configured in the auxiliary broadcast indication packet AUX_ADV_IND to indicate the existence of the PPS application. When the existence of the PPS is indicated in an AUX_ADV_IND packet, the corresponding PPS content is configured in the auxiliary synchronization indication packet AUX_SYNC_IND immediately following the AUX_ADV_IND packet; the UUID of other standard Bluetooth BLE applications can also be configured in the AUX_ADV_IND packet to indicate that other standard Bluetooth BLE applications are also included; The PPS content includes PPS metadata and picture data, wherein the PPS metadata is located in an auxiliary synchronization indication packet AUX_SYNC_IND, and the picture data is located in an auxiliary synchronization indication packet AUX_SYNC_IND and / or a data packet AUX_CHAIN_IND of an auxiliary information chain; The PPS metadata Metadata specifies the structure of the application data, and the PPS metadata Metadata includes a PPS metadata header field and a PPS metadata content field; The PPS metadata header field is used to indicate the algorithm type, picture format, number of pictures and frame rate parameters of the picture; The PPS metadata content field includes parameters for indicating position offset, image size, color mode, resolution, shooting information, compression method and bit depth; wherein the PPS metadata content is configured as an array, the number of elements in the array is related to the number of pictures, and each picture corresponds to its own PPS metadata content field; the position offset is used to indicate the position offset information of this picture within this group of periodic broadcasts. When a periodic broadcast includes multiple data packets, the position offset is a two-dimensional coordinate, and the starting position of the picture data is obtained through the two-dimensional coordinate; the picture data can be dispersed in the net load payload of multiple packets.

7. The method according to claim 5, characterized in that PPS provides a configuration interface, and PP configures it through the configuration interface provided by PPS. The state machine of PPS is configured to include an idle state, a configured state, and a periodic broadcast state. The state change is driven by events; There are multiple instructions for corresponding event settings, including: start instruction Start, stop instruction Stop, shutdown instruction Disable and configuration instruction Configuration. These instructions are used to trigger the corresponding events to change the PPS state; and the reset instruction Reconfiguration corresponding to the Configured state setting, which is used for users to perform more detailed parameter configuration. After the configuration is completed, the PPS remains in the Configured state; and the metadata update instruction corresponding to the Broadcasting state setting, which is used to update the PPS metadata Metadata in the periodic broadcasting state.

8. The method according to claim 7, characterized in that The steps to start and end periodic broadcast transmission by configuring PPS through PP include: Initially, PPS is in Idle state, and the wearable device is in Idle state at this time; Before taking a snapshot, the PPS is configured through the PP trigger configuration command Configuration. After the parameters are configured according to the shooting parameters selected by the user, the PPS enters the Configured state; After the configuration is completed, the start command Start is triggered to start the wearable device's photo taking and periodic broadcasting. At this time, the wearable device enters the Broadcasting state. In the Broadcasting state, the wearable device cycles through the process of taking photos and sending periodic broadcasts, and updates the PPS metadata Metadata at the same time. In the Broadcasting state, when the user triggers the stop command Stop, the wearable device can exit the Broadcasting state and re-enter the Configured state. At this time, the user can reset the parameters through the reset command Reconfiguration. When it is necessary to end the snapshot upload, the shutdown command Disable is triggered, and the wearable device enters the Idle state; wherein, the shutdown command Disable can be triggered by the wearable device side or the first type of mobile device side. Regardless of whether the wearable device is in the Configured state or the Broadcasting state, after the shutdown command Disable is triggered, the wearable device will enter the Idle state.

9. The method according to claim 7 or 8, characterized in that: In the Broadcasting state, the process of updating PPS metadata is as follows: S101, calculating the number of photos taken within the current periodic broadcast interval to obtain a total number of photos M, where M is a natural number greater than 1, and M is less than or equal to the number of photos that can be stored in the reserved memory of the wearable device; S102, calculating the memory size required for the PPS metadata and the picture data, and allocating the memory; S103, filling the PPS metadata header; S104, planning the time point for each photo-taking in this periodic broadcast; S105, setting the photo sequence number N to 0, where N is an integer greater than or equal to 0; S106, waiting for the start of photographing, when the time point for photographing arrives, N is increased by 1; S107, taking photos; S108, extracting PPS metadata content from the current snapshot and putting it into position N of the array; S109, compressing the snapshot data according to the configured compression algorithm, generating compressed image data, and placing it in the corresponding N sequence number position; S110, determine whether N is equal to M; if it is determined to be no, return to step S106; if it is determined to be yes, execute the following steps; S111, divide the data in the memory into packets, put the PPS metadata into the AUX_SYNC_IND packet, and disperse the M picture data into multiple AUX_CHAIN_IND packets; S112, modifying the position offset information in the array element corresponding to the PPS metadata content according to the distribution of the picture data in the AUX_CHAIN_IND packet, so that the position offset information of the picture points to the correct picture data; S113, waiting for the sending anchor point of the periodic broadcast, and sending the PPS data when the sending anchor point of the periodic broadcast arrives; S114, the sending is completed, the memory is released, the next round of periodic broadcasting begins, and the execution returns to step S101.

10. The method according to claim 5, characterized in that The second service BSCS provides corresponding control points for the periodic broadcast assistant to configure the periodic broadcast receiver Sink, so that the periodic broadcast receiver Sink can synchronize with the periodic broadcast source Source and parse the data sent by the periodic broadcast source Source. The steps are as follows: S201, providing service number information Service UUID to the periodic broadcast receiving end Sink to indicate which services the current periodic broadcast source Source supports; S202, providing security information Security Info to the periodic broadcast receiving end Sink to provide the key required for decoding the periodic broadcast source end Source data; S203, providing physical layer information PHY Info to the periodic broadcast receiving end Sink to instruct the periodic broadcast source Source to extend the physical layer protocol and rate-related parameters used for the periodic broadcast; S204, providing periodic broadcast information PA Info to the periodic broadcast receiving end Sink to indicate relevant parameters of the extended periodic broadcast; S205, after receiving the aforementioned Service UUID, Security Info, PHY Info and PAInfo information, the periodic broadcast receiving end Sink starts the synchronization procedure SYNC procedure to synchronize with the periodic broadcast source end Source; Among them, the periodic broadcast receiving end Sink and the periodic broadcast source end Source establish communication through an extended periodic broadcast link. At this time, the periodic broadcast receiving end Sink is configured as follows: at the starting point of the synchronization process, according to its own clock deviation relative to the periodic broadcast source end Source, the next most recent periodic broadcast sending anchor point of the periodic broadcast source end Source, and their respective clock jitter information, calculate the synchronization anchor point and synchronization window. If the periodic broadcast source end Source cannot be synchronized on the calculated synchronization window, it is necessary to wait for the next cycle. Accordingly, the time of the synchronization window is increased to ensure that the periodic broadcast sending anchor point of the next cycle can be synchronized subsequently.

11. A communication system based on low-power Bluetooth BLE, characterized in that: comprising a wearable device and at least one mobile device, The wearable device is configured to: act as a periodic broadcast source, and broadcast the image data through an extended periodic broadcast link when the periodic broadcast time point arrives; The extended periodic broadcast link is based on the broadcast packet set in the BLE periodic broadcast, and is a periodic broadcast of the Wi-Fi mode extended by configuring the parameters of the broadcast packet. The periodic broadcast sending anchor point is still specified according to the BLE protocol; the image data is sent out through the periodic broadcast of the Wi-Fi mode using the relevant 802.11 protocol; The mobile device is configured to: act as a periodic broadcast receiving end Sink, and after being synchronized with the periodic broadcast source device Source, periodically receive data sent by the periodic broadcast source device Source and parse the data.

12. The communication system according to claim 11, characterized in that: The wearable device is smart glasses; The mobile device is a mobile phone, a tablet computer, a smart power bank and / or a smart glasses case. An interface is provided on the device to connect an external Bluetooth adapter Dongle, which supports the extended BLE protocol.

13. A pair of smart glasses, comprising a frame and an optical element held by the frame, wherein the glasses are provided with a processor, a memory, a power supply, a camera and a wireless communication module, wherein the wireless communication module supports Bluetooth Low Energy (BLE) and Wi-Fi communication, and wherein: The processor is configured to perform the following operations: upon receiving a start instruction of a trip snapshot, enter a periodic broadcast state, in the periodic broadcast state, start a camera to take pictures to obtain image data and send a periodic broadcast, and when a time point of the periodic broadcast arrives, broadcast the image data through an extended periodic broadcast link; The extended periodic broadcast link is based on the broadcast packet set in the BLE periodic broadcast, and is a periodic broadcast of the Wi-Fi mode extended by configuring the parameters of the broadcast packet. The periodic broadcast sending anchor point is still specified according to the BLE protocol; the image data is sent out through the periodic broadcast of the Wi-Fi mode using the relevant 802.11 protocol.

Images