A recognition system utilizing an application program to play cloud-based audio and video content

Abstract

This invention provides a point-based identification system that uses an application to play cloud-based audio and video. The system includes a point-based identification device, a printed medium, one or more smart devices and their applications, and a cloud server. Through Bluetooth Low Energy 5.0 multicast technology and a two-stage triggering architecture (first trigger signal and second trigger signal), the system achieves cross-platform (Android, iOS, Windows) dynamic data retrieval and cloud streaming playback. It boasts advantages such as low cost, high stability, and convenient content updates, making it suitable for interactive teaching and guided tour scenarios.

Claims

1. A point recognition system for playing cloud-based audio and video using an application, characterized in that it comprises: (a) a point recognition device, comprising a recognition data reading unit and a first transmission module, wherein the recognition data reading unit is used to obtain recognition information from an invisible identification code of a printed medium, the recognition information including a teaching material code, a timestamp, and language information; the first transmission module is a Bluetooth Low Energy module and backward compatible with low-level Bluetooth modules, used to generate a first trigger signal T1 including the teaching material code, the timestamp, and the language information according to the recognition information, and transmit the first trigger signal T1 to one or more smart devices in a multicast manner; (b) Each of the one or more smart devices is equipped with a trigger receiving unit and an application program, the application program including a platform identification program; the trigger receiving unit is used to receive the first trigger signal T1, and to cause the smart device to automatically launch the application program corresponding to the operating system based on the teaching material code in the first trigger signal T1 and the operating system identified by the platform identification program, and load the teaching material code and the language information; wherein. When both a mobile phone and a tablet on the iOS platform are connected to the recognition system, the recognition system selects the desired smart device to launch based on the suggested launch device and priority order preset by the teaching material code. If the suggested launch device preset by the teaching material code is a tablet, the tablet's application is launched first; otherwise, the mobile phone's application is launched second. (c) The application includes a remote request program to generate a second trigger signal T2 based on the teaching material code and language information in the first trigger signal T1. The second trigger signal T2 is a deep link URL containing the teaching material code and language information. The remote request program translates the deep link URL into a format supported by Android, iOS, or Windows according to the operating system identified by the platform identification program, and transmits the second trigger signal T2 to a cloud server via a network communication module of the smart device using an HTTPS protocol encrypted with TLS 1.

3. And (d) The cloud server stores audio and video resources and has an authorization module. After the cloud server receives the second trigger signal T2, the authorization module verifies the request formed by the second trigger signal T2 based on the user's identity information and manages the resource access permissions. After verifying the request, the cloud server selects and transmits the corresponding audio or video resources in HLS streaming mode according to the teaching material code, the user's identity information, and the device type of the smart device, so that the application can play them on the smart device. The first trigger signal T1 is transmitted from the identification device to the smart device via a Bluetooth Low Energy wireless link, and the second trigger signal T2 is generated by the application based on the parameters contained in the first trigger signal T1 and transmitted from the smart device to the cloud server via a network link.

2. The point identification system as described in claim 1, wherein, The first transmission module transmits the first trigger signal T1 at a transmission rate of 1 Mbps and a frequency band of 2.4 GHz.

3. The point identification system as described in claim 1, wherein, The application dynamically adjusts the playback interface of the audio or video resource based on the operating system identified by the platform's identification program.

4. The point identification system as described in claim 1, wherein, The identification device is a pen, and the identification data reading unit is a CMOS image sensor.

5. The point identification system as described in claim 1, wherein, The invisible identification code is selected from any one or a combination of micro QR codes, infrared dot matrix codes, or AR image markers, and the size of the invisible identification code is between 0.3mm and 1mm.

6. The point identification system as described in claim 1, wherein, This cloud server supports parsing JSON format data.

7. The point identification system as described in claim 1, wherein, The audio or video resources selected and returned by the cloud server are MP3 audio or H.264 video.

8. The point identification system as described in claim 1, wherein, The application supports a maximum cache size of 2GB, progress bar control, and speech rate adjustment from 0.5x to 2x.

9. The point identification system as described in claim 1, wherein, The smart device is selected from one or a combination of a smart TV, an Android phone, an iOS phone, a Windows phone, a tablet computer, and a laptop computer.

10. The point identification system as described in claim 1, wherein, The identification device does not have a built-in storage unit for storing the audio or video resources, and it transmits the identification information obtained from the invisible identification code to the smart device in the first trigger signal T1.

Images