Audio dynamic matching method, device and program product

Abstract

The present disclosure relates to the technical field of Internet of Things, and particularly relates to an audio dynamic matching method, device and program product. The method comprises the following steps: acquiring an identifier stored in an NFC card when the NFC card is sensed through a built-in card reading chip of an Internet of Things device; sending the identifier to a cloud server for audio query, receiving audio material information returned by the cloud server; and playing corresponding audio and triggering light effects according to the audio material information. Only the identifier is stored in the NFC card, and actual audio links can be acquired from the cloud server in real time, so that the problem of link invalidation does not exist. If songs are temporarily replaced on site, the audio link currently actually corresponding to the identifier can be dynamically modified through the cloud server, so that dynamic updating and version control of content played by the Internet of Things device are supported.

Description

Technical Field

[0001] This disclosure relates to the field of Internet of Things (IoT) technology, and in particular to an audio dynamic matching method, apparatus, and program product. Background Technology

[0002] In concerts, sporting events, and other offline activities, audiences typically need to use physical devices such as smartphones, light sticks, and glow sticks to interact with the music. Due to the noise and distractions at live performances, manually pairing these devices is cumbersome and can easily cause users to miss the music playing. Therefore, to quickly match live music, Near Field Communication (NFC) technology can be used. Audiences simply tap their NFC cards against the physical device to play the corresponding song.

[0003] However, this audio triggering method has the following problems: existing NFC cards can only store a single link. When a user touches the card, the physical device will play the song or playlist corresponding to the link. However, if the link expires or the song is changed on-site, the NFC card will become invalid and cannot be dynamically updated according to the situation, resulting in a poor user experience. Summary of the Invention

[0004] This disclosure is made in view of the above-mentioned problems and provides an audio dynamic matching method, apparatus and program product.

[0005] According to one aspect of this disclosure, an audio dynamic matching method is provided for use in an Internet of Things (IoT) device, comprising: The identifier stored in the NFC card is obtained by using the card reader chip built into the IoT device when the NFC card is sensed; Send an identifier to the cloud server to query the audio, and receive the audio material information returned by the cloud server; the cloud server stores the audio link corresponding to the identifier, and the audio material information includes the audio link and lighting information; Based on the audio material information, play the corresponding audio and trigger the lighting effects.

[0006] The benefits of this solution are as follows: the NFC card only stores the identifier, and the actual audio link can be obtained from the cloud server in real time, so there will be no problem of link failure. If the song is changed temporarily on site, the actual audio link corresponding to the identifier can be dynamically modified through the cloud server, which supports dynamic updates and version control of the content played by IoT devices.

[0007] Furthermore, the audio dynamic matching method according to one aspect of this disclosure also includes: The touch type of the NFC card is identified by the card reader chip built into the IoT device; Send the touch type to the cloud server so that the cloud server can query the audio link based on the touch type and identifier.

[0008] In one or more embodiments, the beneficial effects of this solution are as follows: touch types, such as short touch, standard touch, long touch, heavy touch, and double tap, allow the cloud server to return different audio links based on the touch type. For example, a short touch corresponds to a 15-30 second chorus clip, a standard touch corresponds to the full audio link, and a long touch corresponds to the full audio link plus an interlude. By designing multiple touch types and different granularities of returned content, it is beneficial to improve the user experience and the sense of interaction in the live environment.

[0009] Furthermore, the audio dynamic matching method according to one aspect of this disclosure also includes: Starting from the sensing time of the NFC card, obtain the identifiers stored in other NFC cards sensed within a preset time. Based on the sensing time sequence, the identifiers stored in the NFC card and other NFC cards are sequentially stored in the card queue; Send a card queue to the cloud server so that the cloud server can generate audio material information based on the card queue.

[0010] In one or more embodiments, the beneficial effects of this solution are: by recognizing multiple NFC cards in a short time, it supports multi-card recognition and combined playback, which is conducive to creating a richer interactive experience.

[0011] Furthermore, according to one aspect of the audio dynamic matching method disclosed herein, the method further includes: generating a new playback record after playing the corresponding audio and triggering a lighting effect; and sending the playback record to a cloud server.

[0012] In one or more embodiments, the beneficial effect of this solution is that by synchronizing playback records with the cloud server, the cloud server can make personalized recommendations to users based on the playback records.

[0013] According to one aspect of this disclosure, an audio dynamic matching method is provided, applied to a cloud server, comprising: Receive identifiers sent by IoT devices; The system queries the audio link corresponding to the identifier, confirms the existence of the corresponding audio link, and generates audio material information based on the audio link; the audio link is associated with corresponding lighting information. Return audio material information to IoT devices.

[0014] The beneficial effects of this solution are: by querying the corresponding audio link through an identifier, the actual music on-site can be returned to the IoT device, ensuring a good user experience.

[0015] Furthermore, the audio dynamic matching method according to one aspect of this disclosure also includes: Upon receiving an update instruction, delete the audio link corresponding to the identifier; The new audio link specified by the update command will be used as the identifier for the currently corresponding audio link.

[0016] In one or more embodiments, the beneficial effect of this solution is that by updating the audio link corresponding to the identifier in real time, dynamic updates and version control of the content played by IoT devices can be supported.

[0017] Furthermore, according to one aspect of the audio dynamic matching method of this disclosure, after receiving the identifier sent by the IoT device, it further includes: The system identifies the user account bound to the identifier and sends push commands to the third-party device running the user account, so that the third-party device can play audio that matches the light information according to the push commands; And / or, obtain the location information of the IoT device, and based on the location information, identify the on-site sound reinforcement equipment that matches the IoT device; send scheduling instructions to the on-site sound reinforcement equipment so that the on-site sound reinforcement equipment can adjust the audio playback parameters.

[0018] In one or more embodiments, the beneficial effects of this solution are as follows: by sending push commands to third-party devices (such as mobile phones), the third-party devices and IoT devices (such as light sticks) can be controlled to play audio synchronously, such as headphones playing high-fidelity stereo sound synchronized with the light stick lights; by sending scheduling commands to on-site sound reinforcement equipment (such as speakers) to adjust audio playback parameters, such as emitting sound a few milliseconds earlier or later, the physical delay of sound propagation in the air can be offset, ensuring that the sound from the speakers heard by the user's ears is perfectly synchronized with the light stick lights, thus achieving an immersive experience of sound and light synergy.

[0019] Furthermore, according to one aspect of the audio dynamic matching method of this disclosure, after querying the audio link currently corresponding to the identifier, it further includes: If no corresponding audio link exists, identify the user account bound to the identifier; Generate user-favorite tags based on the user's account playback history; Target audio is selected based on user-favorited tags; Use the target audio as the identifier for the currently corresponding audio link.

[0020] In one or more embodiments, the beneficial effect of this solution is that by recording the user's playback history and combining it with song tags (such as style, mood, BPM), it automatically recommends songs of similar style to the user, which helps to improve the personalized experience.

[0021] Furthermore, the audio dynamic matching method according to one aspect of this disclosure also includes: When a card queue is received from an IoT device, a predefined combination table is used to check if the card queue exists; wherein, the card queue stores the identifiers of at least two NFC cards; If a card queue exists in the combination table, a mixing instruction is generated based on the preset rules of the card queue; the mixing instruction is used to find the corresponding mixing version audio and mixed lighting information of the audio link, and audio material information is generated based on the mixing version audio and mixed lighting information; If the card queue does not exist in the combination table, the audio material information corresponding to each identifier is returned to the IoT device in sequence based on the identifier order in the card queue.

[0022] In one or more embodiments, the beneficial effects of this solution are as follows: NFC cards can be divided into various types such as vocalist cards, guitarist cards, and drummer cards. Users can combine different NFC cards (such as vocalist cards + guitarist cards) to "assemble" a brand new mixed version (such as an "unplugged version" that only highlights vocals and guitar) in real time through a cloud server, thereby improving the user's interactive experience.

[0023] According to another aspect of this disclosure, an audio dynamic matching device is provided, including an Internet of Things (IoT) device and a cloud server; Internet of Things (IoT) devices include: The sensing module is used to obtain the identifier stored in the NFC card when the NFC card is sensed by the card reader chip built into the Internet of Things device; The communication module is used to send an identifier to the cloud server for audio querying and to receive audio material information returned by the cloud server. The cloud server stores the audio link corresponding to the identifier, and the audio material information includes the audio link and lighting information. The playback module is used to play the corresponding audio and trigger lighting effects based on the audio material information. Cloud servers include: The receiving module is used to receive identifiers sent by IoT devices; The query module is used to query the audio link corresponding to the identifier, confirm the existence of the corresponding audio link, and generate audio material information based on the audio link; among them, the audio link is associated with corresponding lighting information; The sending module is used to return audio material information to IoT devices.

[0024] According to another aspect of this disclosure, a computer device is provided, including a memory, a processor, and a computer program stored in the memory, the processor executing the computer program to implement the method of one aspect above.

[0025] According to another aspect of this disclosure, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements the method of one aspect above.

[0026] According to another aspect of this disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements the method of the above-described aspect.

[0027] It should be understood that both the foregoing general description and the following detailed description are exemplary and intended to provide further illustration of the claimed technology. Attached Figure Description

[0028] The above and other objects, features, and advantages of this disclosure will become more apparent from the more detailed description of the embodiments thereof in conjunction with the accompanying drawings. The drawings are provided to further illustrate the embodiments of this disclosure and form part of the specification. They are used together with the embodiments of this disclosure to explain the disclosure and do not constitute a limitation thereof. In the drawings, the same reference numerals generally represent the same components or steps.

[0029] Figure 1 This is a system architecture diagram illustrating an audio dynamic matching method according to an embodiment of the present disclosure.

[0030] Figure 2 This is a timing diagram illustrating the application triggering audio playback using an NFC card according to an embodiment of this disclosure.

[0031] Figure 3 This is a flowchart illustrating an audio dynamic matching method according to an embodiment of the present disclosure.

[0032] Figure 4 This is a schematic diagram illustrating the structure of an audio dynamic matching device according to an embodiment of the present disclosure.

[0033] Figure 5 This is a schematic diagram illustrating the structure of a computer device according to an embodiment of the present disclosure.

[0034] Figure 6 This is a schematic diagram illustrating a computer program product according to an embodiment of the present disclosure. Detailed Implementation

[0035] To make the objectives, technical solutions, and advantages of this disclosure more apparent, exemplary embodiments according to this disclosure will now be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are merely some embodiments of this disclosure, and not all embodiments of this disclosure. It should be understood that this disclosure is not limited to the exemplary embodiments described herein.

[0036] In concerts, sporting events, and other offline activities, audiences typically need to use physical devices such as smartphones, light sticks, and glow sticks to interact with the music. Due to the noise and distractions at live performances, manually pairing these devices is cumbersome and can easily cause users to miss the music playing. Therefore, to quickly match live music, Near Field Communication (NFC) technology can be used. Audiences simply tap their NFC cards against the physical device to play the corresponding song.

[0037] However, this audio triggering method has the following problems: existing NFC cards can only store a single link. When a user touches the card, the physical device will play the song or playlist corresponding to the link. However, if the link expires or the song is changed on-site, the NFC card will become invalid and cannot be dynamically updated according to the situation, resulting in a poor user experience.

[0038] The above description, with reference to the accompanying drawings, illustrates an audio dynamic matching method, apparatus, and program product according to embodiments of the present disclosure. By designing an identifier for the NFC card, the actual audio link can be obtained from the cloud server in real time, eliminating the problem of NFC card failure. If the song is changed temporarily on-site, the identifier can be dynamically modified through the cloud server to dynamically update the audio link currently corresponding to it, supporting dynamic updates and version control of playback content on IoT devices.

[0039] The cloud server allows for synchronized audio and visual control of IoT devices (light sticks), third-party devices (mobile phones), and on-site sound reinforcement equipment (speakers), enhancing the user's immersive experience. Personalized recommendations can be provided based on the user's playback history, further improving the user experience.

[0040] To facilitate understanding of this embodiment, a detailed description of the audio dynamic matching method disclosed in this disclosure will be provided first. The executing entity of the audio dynamic matching method provided in this disclosure is generally a computer device with a certain computing power. In some possible implementations, the audio dynamic matching method can be implemented by a processor calling computer-readable instructions stored in memory.

[0041] like Figure 1 The diagram shown is a system architecture diagram of the audio dynamic matching method provided in this embodiment of the present disclosure, including a cloud server 1, an Internet of Things device 2, a third-party device 3, and a field sound reinforcement device 4. The following is a detailed description.

[0042] Cloud server 1: Stores an audio library and returns corresponding audio information to IoT devices (such as light sticks) based on the identifier (UID) of the NFC card. The audio information includes the audio link corresponding to the UID and the light information. The audio link is such as UID=song A, and the light information can be represented by encoding, such as the value 0x03 representing "rapid red flashing".

[0043] Furthermore, cloud server 1 can also modify the audio associated with the identifier based on the actual audio being played on-site. For example, if UID = song A, but the song is changed temporarily on-site, it can be modified to UID = song B through the cloud server to ensure that the NFC card does not become invalid, thus realizing the dynamic update of the playback content on the user end (such as IoT devices).

[0044] Optionally, in this embodiment, the cloud server 1 is further configured to: after querying the audio link currently corresponding to the identifier, if no corresponding audio link is found, identify the user account bound to the UID; generate user favorite tags based on the user account's playback history; filter out target audio based on the user favorite tags; and use the target audio as the audio link currently corresponding to the identifier.

[0045] Specifically, if the UID is not bound to any song, the cloud server may not return any song or may return a preset song, but this song may not suit the user's preferences. This embodiment provides intelligent personalized recommendations. After the IoT device plays the corresponding audio and triggers the lighting effects, it synchronizes the playback history generated by the user's account to the cloud server. At this point, if the cloud server finds that the UID is not bound to any song, it first queries the user account bound to the UID and the playback history, generating user-preferred tags, such as style, mood, BPM, and lyrical qualities. Based on these tags, it filters one or more target audio tracks from the music library that may match the user's preferences and returns them to the user for playback. Furthermore, the cloud server forcibly associates this playback history with the user account, achieving a feedback loop and improving the accuracy of the algorithm's recommendations.

[0046] Optionally in this embodiment, the cloud server 1 is also used to: identify the user account bound to the UID, and send a push command to the third-party device 3 running the user account, so that the third-party device 3 can play audio that matches the light information according to the push command. The third-party device 3 is, for example, a mobile phone or tablet. Taking a mobile phone as an example, the cloud server pushes the command to the mobile app under the user account via WebSocket or MQTT protocol. After receiving the push command, the mobile app automatically calls the system audio API to play high-fidelity stereo sound that is completely synchronized with the light of the light stick from the speaker or connected headphones.

[0047] Optionally in this embodiment, the cloud server 1 is also used to: obtain the location information of the IoT device; based on the location information, identify the on-site sound reinforcement device 4 (such as a speaker) that matches the IoT device; and send scheduling instructions to the on-site sound reinforcement device 4 so that the on-site sound reinforcement device 4 can adjust the audio playback parameters. Table 1 shows the location information source and priority table: Table 1. Location Information Sources and Priorities

[0048] For example, based on the location information of the light sticks, if a user is confirmed to be in the "Zone_A front row" of the venue, the professional sound reinforcement system on site, upon receiving the dispatch instruction, can control the speakers in Zone_A to emit sound a few milliseconds earlier or later. This cancels out the physical delay of sound propagation in the air, ensuring that the sound heard by the user's ears is synchronized with the light stick's lighting. Through the light sticks (light synchronization), mobile phones, and on-site speakers (public amplification), an immersive experience of sound and light synergy is achieved. As shown in Table 2, the venue area division definition table is as follows: Table 2. Venue Area Division Definition Table

[0049] As shown in Table 3, this is a table defining the differentiated audio playback parameters for this embodiment. The on-site sound reinforcement device 4 can, according to... Figure 3 Adjust the audio playback parameters.

[0050] Table 3. Definition of Differentiated Audio Playback Parameters

[0051] IoT Device 2: Using its built-in card reader chip, it retrieves the identifier stored in an NFC card upon sensing it; it then sends the identifier to a cloud server to query the audio; based on the audio material information returned by the cloud server, it plays the corresponding audio and triggers a light effect. Notably, the NFC card only stores a unique identifier (UID) and no longer stores a directly corresponding audio link; the actual audio is obtained from the cloud server in real time.

[0052] Optionally, in this embodiment, the IoT device 2 is also used to: identify the touch type of the NFC card through the built-in card reader chip; the cloud server can return audio links of different granularities based on the touch type and UID. Table 4 shows the touch detection parameter table: Table 4 Touch Detection Parameters

[0053] As shown in Table 5, this is the touch type response table. The cloud server can return the corresponding audio link based on Table 5. For example, if UID = song A, a standard touch will return the standard version of the audio for song A, while a short touch will return a 15-30 second segment of song A.

[0054] Table 5 Touch Type Response Table

[0055] Table 6 shows the response frame format definition table: Table 6 Response Frame Format Definition Table

[0056] Optionally, in this embodiment, the IoT device 2 is further configured to: obtain the identifiers stored in other NFC cards sensed within a preset time, starting from the sensing time of the NFC card; sequentially store the identifiers stored in the NFC card and other NFC cards into a card queue according to the sensing time order; and generate audio material information based on the card queue by the cloud server.

[0057] NFC cards can be categorized into various types, such as lead vocalist cards, guitarist cards, drummer cards, and backing vocalist cards. Combining different cards provides users with a richer interactive experience. Specifically, IoT device 2 supports the simultaneous or short-term recognition of multiple NFC cards (multi-UID queue). The cloud server returns mixed audio based on the card queue, supporting multi-card recognition and combined playback, creating a richer interactive experience for users. Table 7 shows the multi-card recognition mechanism: Table 7 Multi-card recognition mechanism table

[0058] As shown in Table 8, which is the mixing combination rule table, cloud server 1 checks whether a card queue exists according to Table 8. For example, if the card queue sent by the IoT device is {UID1, UID2}, where UID1 is the lead vocal card and UID2 is the guitarist card, then the "two-person instrument separation version" can be mixed according to the rules in Table 8 to generate the final audio material information. If UID1 is the guitarist card and UID2 is the backing vocal card, and this card combination does not exist, then cloud server 1 can return the audio links corresponding to UID1 and UID2 to the IoT device in sequence, without performing mixing. Alternatively, cloud server 1 can use AI real-time mixing (with an increased latency of 1-3 seconds).

[0059] Table 8 Mixing Combination Rules

[0060] Specifically, the cloud server can pre-store the original multi-track audio files (vocals, guitar, bass, drums, etc.). During mixing, tracks are selectively mixed according to combination rules. For example, in a duet version, the vocals and main guitar are kept while the volume of other tracks is reduced; in a chorus version, the gain of multiple vocal tracks is superimposed.

[0061] like Figure 2 The diagram shows the timing of audio playback triggered by an NFC card: (a) The user touches the light stick with the NFC card to sense it; (b) The light stick sends the recognized UID to the cloud server to query the audio link; (c) The cloud server returns the audio link to the light stick based on the query result, and simultaneously pushes the audio stream to the mobile phone and speaker; (d) The light stick downloads the song based on the audio link; (e) The light stick, mobile phone, and speaker play the song synchronously; (f) The light stick synchronizes the playback record to the cloud server; (g) The user is notified that the playback was successful.

[0062] Based on the above embodiments, this embodiment also provides an audio dynamic matching method, such as... Figure 3 The diagram shows a flowchart of the audio dynamic matching method, where S301-S303 are applied to IoT devices, and S304-S306 are applied to cloud servers.

[0063] S301: When an NFC card is sensed, the identifier stored in the NFC card is obtained through the card reader chip built into the IoT device.

[0064] S302: Send an identifier to the cloud server to query the audio, and receive the audio material information returned by the cloud server.

[0065] The cloud server stores audio links corresponding to identifiers, and the audio material information includes audio links and lighting information.

[0066] S303: Based on the audio material information, play the corresponding audio and trigger the lighting effect.

[0067] S304: Receive the identifier sent by the IoT device.

[0068] S305: Query the audio link corresponding to the current identifier, confirm the existence of the corresponding audio link, and generate audio material information based on the audio link.

[0069] The audio links are associated with corresponding lighting information.

[0070] S306: Return audio material information to IoT devices.

[0071] In one or more embodiments, the method performed by the IoT device further includes: The IoT device uses a built-in card reader chip to identify the touch type of the NFC card. The touch type is then sent to the cloud server, which queries the audio link based on the touch type and identifier. As shown in Table 5, the touch type response table includes short touch, standard touch, long touch, heavy touch, and double tap, among others. The cloud server can return different audio links based on the touch type. For example, a short touch corresponds to a 15-30 second chorus clip, a standard touch corresponds to the full audio link, and a long touch corresponds to the full audio link plus an interlude. By designing multiple touch types and different levels of returned content, the user experience and on-site interaction are improved.

[0072] In one or more embodiments, the method performed by the IoT device further includes: Starting from the sensing time of the NFC card, the identifiers stored in other NFC cards sensed within a preset time are obtained; according to the sensing time order, the identifiers stored in the NFC card and other NFC cards are sequentially stored in the card queue; the card queue is sent to the cloud server so that the cloud server can generate audio material information based on the card queue.

[0073] The NFC cards can be categorized into various types, such as lead vocalist cards, guitarist cards, drummer cards, and backing vocal cards. Combining different cards provides users with a richer interactive experience. Specifically, IoT device 2 supports the simultaneous or short-term recognition of multiple NFC cards (multi-UID queue). The cloud server returns mixed audio based on the card queue, supporting multi-card recognition and combined playback, creating a more engaging interactive experience for users.

[0074] In one or more embodiments, the method performed by the IoT device further includes: generating a new playback record after playing corresponding audio and triggering a light effect; and sending the playback record to a cloud server. Synchronizing the playback record with the cloud server allows the cloud server to make personalized recommendations to the user based on the playback record.

[0075] In one or more embodiments, the method executed by the cloud server further includes: upon receiving an update instruction, deleting the audio link corresponding to the identifier; and using the new audio link specified by the update instruction as the audio link currently corresponding to the identifier. By updating the audio link corresponding to the identifier in real time, dynamic updates and version control of the content played by IoT devices can be supported.

[0076] In one or more embodiments, the method performed by the cloud server further includes: The system identifies the user account bound to the identifier and sends push commands to the third-party device running the user account, so that the third-party device can play audio that matches the light information according to the push commands; And / or, obtain the location information of the IoT device, and based on the location information, identify the on-site sound reinforcement equipment that matches the IoT device; send scheduling instructions to the on-site sound reinforcement equipment so that the on-site sound reinforcement equipment can adjust the audio playback parameters.

[0077] By sending push commands to third-party devices (such as mobile phones), it is possible to control the synchronous playback of audio between these devices and IoT devices (such as light sticks). For example, headphones can play high-fidelity stereo sound synchronized with the light stick's lights. By sending scheduling commands to on-site sound reinforcement equipment (such as speakers) to adjust audio playback parameters, such as advancing or delaying sound by a few milliseconds, the physical delay of sound propagation in the air can be offset, ensuring that the sound heard by the user's ears from the speakers and the light stick's lights are perfectly synchronized, achieving an immersive sound and light synergy experience.

[0078] In one or more embodiments, the method performed by the cloud server, after querying the audio link currently corresponding to the identifier, further includes: If no corresponding audio link exists, identify the user account bound to the identifier; generate user favorite tags based on the user account's playback history; filter out target audio based on user favorite tags; and use the target audio as the audio link currently corresponding to the identifier.

[0079] By recording users' playback history and combining it with song tags (such as style, mood, BPM), the system can automatically recommend songs of similar styles to users, which helps to improve the personalized experience.

[0080] In one or more embodiments, the method performed by the cloud server further includes: When a card queue is received from an IoT device, a predefined combination table is used to check if the card queue exists; wherein, the card queue stores the identifiers of at least two NFC cards; If a card queue exists in the combination table, a mixing instruction is generated based on the preset rules of the card queue; the mixing instruction is used to find the corresponding mixing version audio and mixed lighting information of the audio link, and audio material information is generated based on the mixing version audio and mixed lighting information; If the card queue does not exist in the combination table, the audio material information corresponding to each identifier is returned to the IoT device in sequence based on the identifier order in the card queue.

[0081] Cloud server 1 checks Table 8 to see if a card queue exists. For example, if the card queue sent by the IoT device is {UID1, UID2}, where UID1 is the lead vocal card and UID2 is the guitarist card, then it can perform a "two-person instrument separation version" mix according to the rules in Table 8 to generate the final audio material information. If UID1 is the guitarist card and UID2 is the backing vocal card, and this card combination does not exist, then cloud server 1 can return the audio links corresponding to UID1 and UID2 to the IoT device in sequence, without performing any further mixing. Alternatively, cloud server 1 can use AI real-time mixing (with an increased latency of 1-3 seconds).

[0082] According to another aspect of the embodiments of this disclosure, an audio dynamic matching device is provided, such as... Figure 4 As shown, the device includes an Internet of Things (IoT) device and a cloud server. The IoT device includes: The sensing module 401 is used to obtain the identifier stored in the NFC card when the NFC card is sensed by the card reader chip built into the Internet of Things device; The communication module 402 is used to send an identifier to the cloud server for audio query and receive audio material information returned by the cloud server; wherein, the cloud server stores the audio link corresponding to the identifier, and the audio material information includes the audio link and light information; The playback module 403 is used to play the corresponding audio and trigger the lighting effects based on the audio material information. Cloud servers include: The receiving module 404 is used to receive identifiers sent by IoT devices; The query module 405 is used to query the audio link corresponding to the identifier, confirm the existence of the corresponding audio link, and generate audio material information based on the audio link; wherein, the audio link is associated with corresponding lighting information; The sending module 406 is used to return audio material information to IoT devices.

[0083] The audio dynamic matching device and the audio dynamic matching method provided in this disclosure are based on the same inventive concept and have the same beneficial effects as the methods they adopt, operate or implement.

[0084] This disclosure also provides a computer device for performing the above-described audio dynamic matching method. Please refer to... Figure 5 It illustrates a schematic diagram of a computer device provided by some embodiments of this disclosure. For example... Figure 5As shown, the computer device 5 includes: a processor 500, a memory 501, a bus 502, and a communication interface 503. The processor 500, the communication interface 503, and the memory 501 are connected via the bus 502. The memory 501 stores a computer program that can run on the processor 500. When the processor 500 runs the computer program, it executes the audio dynamic matching method provided in any of the foregoing embodiments of this disclosure.

[0085] The memory 501 may include high-speed random access memory (RAM) or non-volatile memory, such as at least one disk storage device. Communication between this device network element and at least one other network element is achieved through at least one communication interface 503 (which can be wired or wireless), such as the Internet, wide area network, local area network, metropolitan area network, etc.

[0086] Bus 502 can be an ISA bus, PCI bus, or EISA bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. The memory 501 is used to store programs. After receiving an execution instruction, the processor 500 executes the program. The audio dynamic matching method disclosed in any of the foregoing embodiments of this disclosure can be applied to the processor 500, or implemented by the processor 500.

[0087] The processor 500 may be an integrated circuit chip with signal processing capabilities. In implementation, each step of the above method can be completed by the integrated logic circuitry in the hardware of the processor 500 or by instructions in software form. The processor 500 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), an off-the-shelf programmable gate array (FPTA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this disclosure. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this disclosure can be directly embodied in the execution of a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software modules may reside in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. The storage medium is located in memory 501. The processor 500 reads the information in memory 501 and, in conjunction with its hardware, completes the steps of the above method.

[0088] The computer device provided in this disclosure and the audio dynamic matching method provided in this disclosure are based on the same inventive concept and have the same beneficial effects as the methods they employ, operate, or implement.

[0089] This disclosure also provides a computer-readable storage medium corresponding to the audio dynamic matching method provided in the foregoing embodiments. The computer-readable storage medium is an optical disc, on which a computer program (i.e., a computer program product) is stored. When the computer program is run by a processor, it executes the audio dynamic matching method provided in any of the foregoing embodiments.

[0090] It should be noted that examples of the computer-readable storage medium may also include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other optical and magnetic storage media, which will not be elaborated here.

[0091] The computer-readable storage medium provided in the above embodiments of this disclosure and the audio dynamic matching method provided in the embodiments of this disclosure are based on the same inventive concept and have the same beneficial effects as the methods adopted, run or implemented by the applications stored therein.

[0092] This disclosure also provides a computer program product; please refer to [link / reference]. Figure 6 The computer program product 600 carries program code, namely computer program 601. The instructions included in the computer program 601 can be used to execute the steps of the audio dynamic matching method described in the above method embodiments. For details, please refer to the above method embodiments, which will not be repeated here.

[0093] The aforementioned computer program product can be implemented through hardware, software, or a combination thereof. In one optional embodiment, the computer program product is specifically embodied in a computer storage medium; in another optional embodiment, the computer program product is specifically embodied in a software product, such as a software development kit (SDK), etc.

[0094] The basic principles of this disclosure have been described above with reference to specific embodiments. However, it should be noted that the advantages, benefits, and effects mentioned in this disclosure are merely examples and not limitations, and should not be considered as essential features of each embodiment of this disclosure. Furthermore, the specific details disclosed above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the scope of this disclosure to the necessity of employing the aforementioned specific details for implementation.

[0095] The block diagrams of devices, apparatuses, devices, and systems disclosed herein are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as “comprising,” “including,” “having,” etc., are open-ended terms meaning “including but not limited to,” and are used interchangeably with them. The terms “or” and “and” as used herein refer to the terms “and / or,” and are used interchangeably with them unless the context clearly indicates otherwise. The term “such as” as used herein refers to the phrase “such as but not limited to,” and is used interchangeably with it.

[0096] Additionally, as used herein, the "or" used in a list of items beginning with "at least one" indicates a separate list, such that a list of, for example, "at least one of A, B, or C" means A or B or C, or AB or AC or BC, or ABC (i.e., A and B and C). Furthermore, the word "exemplary" does not imply that the described example is preferred or better than other examples.

[0097] It should also be noted that in the systems and methods of this disclosure, the components or steps can be decomposed and / or recombined. These decompositions and / or recombinations should be considered as equivalent solutions to this disclosure.

[0098] Various changes, substitutions, and modifications can be made to the technology described herein without departing from the teachings defined by the appended claims. Furthermore, the scope of the claims of this disclosure is not limited to the specific aspects of the processes, machines, manufactures, events, means, methods, and actions described above. Currently existing or later-developed processes, machines, manufactures, events, means, methods, or actions that perform substantially the same function or achieve substantially the same result as the corresponding aspects described herein can be utilized. Therefore, the appended claims include such processes, machines, manufactures, events, means, methods, or actions within their scope.

[0099] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use this disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of this disclosure. Therefore, this disclosure is not intended to be limited to the aspects shown herein, but rather to be carried out within the widest scope consistent with the principles and novel features disclosed herein.

[0100] The above description has been given for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of this disclosure to the forms disclosed herein. Although numerous exemplary aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, alterations, additions, and sub-combinations thereof.

Claims

1. An audio dynamic matching method, characterized in that, Applied to IoT devices, including: The identifier stored in the NFC card is obtained by using the card reader chip built into the IoT device when the NFC card is sensed; Send the identifier to the cloud server to perform an audio query, and receive the audio material information returned by the cloud server; wherein, the cloud server stores the audio link corresponding to the identifier, and the audio material information includes the audio link and lighting information; Based on the audio material information, play the corresponding audio and trigger the lighting effect.

2. The audio dynamic matching method as described in claim 1, characterized in that, Also includes: The touch type of the NFC card is identified by the card reader chip built into the IoT device; The touch type is sent to the cloud server so that the cloud server can query the audio link based on the touch type and the identifier.

3. The audio dynamic matching method as described in claim 1, characterized in that, Also includes: Starting from the sensing time of the NFC card, obtain the identifiers stored in other NFC cards sensed within a preset time. According to the sensing time sequence, the identifiers stored in the NFC card and the other NFC cards are sequentially stored in the card queue; The card queue is sent to the cloud server so that the cloud server can generate audio material information based on the card queue.

4. An audio dynamic matching method, characterized in that, Applications to cloud servers include: Receive identifiers sent by IoT devices; The system queries the audio link currently corresponding to the identifier, confirms the existence of a corresponding audio link, and generates audio material information based on the audio link; wherein, the audio link is associated with corresponding lighting information. Return the audio material information to the Internet of Things (IoT) device.

5. The audio dynamic matching method as described in claim 4, characterized in that, Also includes: Upon receiving an update instruction, delete the audio link corresponding to the identifier; The new audio link specified by the update instruction is used as the audio link currently corresponding to the identifier.

6. The audio dynamic matching method as described in claim 4, characterized in that, After receiving the identifier sent by the IoT device, it also includes: Identify the user account bound to the identifier and send a push command to the third-party device running the user account, so that the third-party device can play audio that matches the light information according to the push command; And / or, obtain the location information of the IoT device, and based on the location information, identify the on-site sound reinforcement equipment that matches the IoT device; send a scheduling command to the on-site sound reinforcement equipment so that the on-site sound reinforcement equipment can adjust the audio playback parameters.

7. The audio dynamic matching method as described in claim 4, characterized in that, After querying the audio link currently corresponding to the identifier, the process also includes: If no corresponding audio link exists, identify the user account bound to the identifier; Based on the user account's playback history, generate the user's favorite tags; Based on the user's preferred tags, the target audio was selected; The target audio is used as the audio link currently corresponding to the identifier.

8. The audio dynamic matching method as described in claim 4, characterized in that, Also includes: Upon receiving the card queue sent by the IoT device, the system queries a predefined combination table to see if the card queue exists; wherein the card queue stores identifiers of at least two NFC cards. If the card queue exists in the combination table, a mixing instruction is generated based on the preset rules of the card queue; the mixing instruction is used to find the mixed version audio and mixed lighting information corresponding to the audio link, and the audio material information is generated based on the mixed version audio and the mixed lighting information; If the card queue does not exist in the combination table, the audio material information corresponding to each identifier is returned to the IoT device in sequence based on the identifier order in the card queue.

9. An audio dynamic matching device, characterized in that, This includes IoT devices and cloud servers; The IoT devices include: The sensing module is used to obtain the identifier stored in the NFC card when the NFC card is sensed by the card reader chip built into the Internet of Things device; The communication module is used to send the identifier to the cloud server for audio querying and to receive audio material information returned by the cloud server; wherein, the cloud server stores the audio link corresponding to the identifier, and the audio material information includes the audio link and light information; The playback module is used to play the corresponding audio and trigger lighting effects based on the audio material information. The cloud server includes: The receiving module is used to receive identifiers sent by IoT devices; The query module is used to query the audio link currently corresponding to the identifier, confirm the existence of the corresponding audio link, and generate audio material information based on the audio link; wherein, the audio link is associated with corresponding lighting information; The sending module is used to return the audio material information to IoT devices.

10. A computer program product, comprising a computer program, characterized in that, When executed by a processor, the computer program implements the method described in any one of claims 1 to 8.

Images