Interaction method and system, lying and sitting equipment, intelligent bed and entity space

Abstract

The embodiment of the invention provides an interaction method and system, lying and sitting equipment, an intelligent bed and an entity space. The method comprises the following steps: collecting audio frequency information output by playing equipment; determining whether the audio frequency information contains a target audio frequency meeting requirements or not; determining interaction information corresponding to a target audio frequency when the audio frequency information contains the target audio frequency meeting the requirement; and according to the interaction information, an adaptive interaction execution device is controlled to execute a corresponding interaction action. By adopting the technical scheme provided by the embodiment of the invention, the adaptive interactive feedback can be given to the user for the specific audio frequency by utilizing the audio frequency related identification technology, the scheme is simple to implement, and the experience feeling can be enhanced for the user in the film watching and game playing processes of the user.

Description

Technical Field

[0001] The present application relates to the field of smart home technology, and in particular to an interactive method, system, lying and sitting device, smart bed, and physical space. Background Art

[0002] With the popularization of smart home devices, smart lying and sitting devices such as smart beds are gradually entering people's lives.

[0003] Smart reclining equipment is a kind of rest equipment with intelligent functions. Taking smart beds as an example, their intelligent functions may include video viewing, aromatherapy, lifting, massage, heating, etc. However, at present, when smart beds provide video viewing functions, most of what they can do is simply to allow users to watch videos, lacking the interaction between videos and users, and the user video viewing experience is poor. Summary of the invention

[0004] The embodiments of the present application provide a solution or at least a partial solution to the interactive method, system, lying and sitting device, smart bed, and physical space provided above.

[0005] In one embodiment of the present application, an interactive method is provided. The interactive method includes:

[0006] Collect audio information output by the playback device;

[0007] Determining whether the audio information contains target audio that meets the requirements;

[0008] When the audio information contains a target audio that meets the requirements, determining interactive information corresponding to the target audio;

[0009] According to the interaction information, the adapted interaction execution device is controlled to execute corresponding interaction actions.

[0010] In another embodiment of the present application, an interactive system is also provided. The interactive system includes:

[0011] Playback device;

[0012] Interactive execution equipment;

[0013] The processing device is communicatively connected with the playback device and the interactive execution device, and is used for collecting audio information output by the playback device; determining whether the audio information contains target audio that meets the requirements; when the audio information contains target audio that meets the requirements, determining interactive information corresponding to the target audio; and controlling the adapted interactive execution device to perform corresponding interactive actions according to the interactive information.

[0014] In another embodiment of the present application, a lying sitting device is also provided. The lying sitting device comprises:

[0015] A device body is located in the physical space; a part of the plurality of interactive execution devices is arranged on the device body, and the remaining part of the interactive execution devices is arranged in the physical space;

[0016] A processing device is arranged on the device body and is communicatively connected with the multiple interactive execution devices, and is used to collect audio information output by the playback device; determine whether the audio information contains target audio that meets the requirements; when the audio information contains target audio that meets the requirements, determine interactive information corresponding to the target audio; and control the adapted interactive execution device among the multiple interactive execution devices to perform corresponding interactive actions according to the interactive information.

[0017] In another embodiment of the present application, a smart bed is provided. The smart bed comprises:

[0018] A bed body is located in the physical space; a part of the plurality of interactive execution devices is arranged on the bed body, and the remaining part of the interactive execution devices is arranged in the physical space;

[0019] A processing device is arranged on the bed, is communicatively connected with the plurality of interactive devices, and is used for collecting audio information output by a playback device; determining whether the audio information contains a target audio that meets the requirements; when the audio information contains a target audio that meets the requirements, determining interactive information corresponding to the target audio; and according to the interactive information, controlling the adapted interactive execution device to execute a corresponding interactive action.

[0020] In another embodiment of the present application, a physical space is provided. The physical space includes:

[0021] A playback device; and a lying device as provided in an embodiment of the present application;

[0022] Wherein, the lying and sitting device is any one of the following: a smart bed, a smart chair, and a smart sofa.

[0023] The technical solutions provided in the embodiments of the present application, for the audio information collected and output by the playback device, will determine whether the audio information contains the target audio that meets the requirements; and if the audio information contains the target audio that meets the requirements, it will further determine the interactive information corresponding to the target audio, and control the adapted interactive execution device to perform the corresponding interactive action according to the interactive information. It can be seen that this solution can use the audio-related recognition technology to give users adaptive interactive feedback for specific audio. The solution is simple to implement, and it can also enhance the user experience during the process of watching movies and playing games. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following is a brief introduction to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0025] Figure 1a A schematic diagram of the structure of an interactive system provided in one embodiment of the present application;

[0026] Figure 1b A schematic diagram of the structure of an interactive system provided by another embodiment of the present application;

[0027] Figure 2 A schematic diagram of the structure of an interactive method provided in one embodiment of the present application;

[0028] Figure 3a A schematic diagram of the structure of a smart bed provided in one embodiment of the present application;

[0029] Figure 3b A schematic diagram of the structure of a smart bed provided in another embodiment of the present application;

[0030] Figure 4 A schematic diagram of the structure of a computer program product provided in one embodiment of the present application. DETAILED DESCRIPTION

[0031] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0032] In some processes described in the specification, claims and the above-mentioned figures of the present application, multiple operations appearing in a specific order are included, and these operations may not be executed or executed in parallel in the order in which they appear in this article. The serial numbers of the operations, such as 101, 102, etc., are only used to distinguish different operations, and the serial numbers themselves do not represent any execution order. In addition, these processes may include more or fewer operations, and these operations may be executed in sequence or in parallel. It should be noted that the descriptions of "first", "second", etc. in this article are used to distinguish different messages, devices, modules, etc., do not represent the order of precedence, and do not limit "first" and "second" to different types. In addition, the following embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without making creative work are within the scope of protection of this application.

[0033] Before introducing the method provided in the embodiment of the present application, in order to facilitate the understanding of the method, the corresponding system provided in the present application is first introduced and explained.

[0034] Figure 1a and Figure 1b FIG. 1 shows a schematic diagram of the structure of the interactive system provided in the embodiment of the present application. Figure 1a and Figure 1b As shown, the interactive system includes: a playback device 10, an interactive execution device 20 and a processing device 30; wherein,

[0035] The processing device 30 is communicatively connected with the playback device and the interactive execution device, and is used to collect audio information output by the playback device; determine whether the audio information contains target audio that meets the requirements; when the audio information contains target audio that meets the requirements, determine interactive information corresponding to the target audio; and control the adapted interactive execution device to perform corresponding interactive actions according to the interactive information.

[0036] In the above, the playback device is a device that has the function of playing audio and video. For example, it can be a terminal device used by users, such as a smart phone, a game console, a personal computer (PC), a smart wearable device (such as a smart bracelet), etc.; wherein the PC can be a desktop computer, a laptop, a tablet computer, and an ultrabook, etc. For another example, it can also be a projection device, a television, etc., wherein the audio and video of the projection device can come from the terminal device.

[0037] In specific implementation, the above-mentioned playback device can realize audio playback in at least one of the following ways:

[0038] Method 1: The audio can be played through an external device connected to it that has at least an audio playback function;

[0039] Among them, the connection method between the playback device and the external device can be but is not limited to wired or wireless. The wired method can be, for example, HDMI (High Definition Multimedia Interface), USB (Universal Serial Bus), etc., and the wireless method can be, for example, Bluetooth, WiFi (wireless fidelity), etc.

[0040] Method 2: You can play audio through your own system.

[0041] For example, the playback device is a laptop computer. After connecting it to a video device such as a TV through an HDMI interface on the laptop computer using a corresponding HDMI cable, the sound page can be entered through the sound setting item in the control panel of the laptop computer. In the sound page, a TV device with an HDMI logo can be selected as the default device; after the setting is completed, the audio signal and / or video signal output by the laptop computer can flow into the TV to which it is connected, so that the corresponding audio and / or video can be played through the TV.

[0042] For another example, if the playback device is a smart phone, after the smart phone is connected to a speaker using a wired method such as USB or a wireless method such as Bluetooth, the audio signal output by the smart phone will be amplified and played through the speaker.

[0043] For another example, the playback device is a game console, which has a built-in sound card system. When a user uses the game console to play a game, the game audio generated in the game can also be played through the built-in sound card system without the aid of any external device.

[0044] In one possible implementation, see Figure 1a As shown, the processing device 30 may be a hardware device independent of the playback device 10. In this case, the processing device 30 may specifically include: an input unit, a processing unit, and an output unit; wherein,

[0045] An input unit, used to collect audio information output by the playback device and send the audio information to the processing unit;

[0046] The processing unit is used to process the received audio information and send the processing result to the adapted interactive execution device through the output unit to control the adapted interactive execution device to perform the corresponding interactive action. Specifically, the processing unit is used to determine whether the audio information meets the required target audio; when the audio information contains the target audio that meets the requirements, determine the interactive information corresponding to the target audio; and send the interactive information to the adapted interactive execution device through the output unit.

[0047] In the above, in a specific example, the above input unit can obtain the audio information output by the playback device through wired or wireless means. For example, assuming that the processing device 30 is hardware built into the audio system, after the audio system obtains the corresponding audio signal from the playback device connected to it through Bluetooth or USB data cable, the audio signal can first be input into the input unit of the processing device 30 arranged in the audio system to be processed by the processing unit connected to the input unit; in addition, the audio system will also amplify and play the obtained audio signal through the built-in audio playback system. In another specific example, the processing device 30 can also be an independent device that does not rely on any device and is provided with a microphone system; accordingly, the input unit in the processing device 30 can collect the audio played by the playback system through the microphone system.

[0048] In another possible implementation, see Figure 1b The processing device 30 can also be a software device (a computer program) that runs directly in the playback device. The audio obtained by the processing device 20 comes directly from the playback device, and the result of its operation can be directly sent to the adapted interactive execution device via the playback device in a wired or wireless manner.

[0049] For a detailed introduction to the interactive execution device, please refer to the relevant contents in other embodiments below. The communication connection mode between the processing device 30 and the interactive execution device can be wired or wireless, which is not limited here.

[0050] In addition, the specific implementation of the functions of the above-mentioned processing device 30 will be described in detail in the following method embodiment.

[0051] Figure 2 A schematic diagram of the flow of an interactive method provided by an embodiment of the present application is shown. The execution subject of the interactive method is Figure 1a or Figure 1b The processing device 30 shown in the figure may be a hardware device or a software device having logic calculation and data processing capabilities. Figure 2 As shown, the interactive method provided in this embodiment includes the following steps:

[0052] 101. Collecting audio information output by a playback device;

[0053] 102. Determine whether the audio information contains target audio that meets the requirements;

[0054] 103. When the audio information includes a target audio that meets the requirements, determining interactive information corresponding to the target audio;

[0055] 104. According to the interaction information, control an adapted interaction execution device to execute a corresponding interaction action.

[0056] In the above 101, the audio information output by the playback device may be, but is not limited to, the audio in the audio and video, or the audio in the game, etc., which is not specifically limited here. For the specific implementation of the above playback device and the processing device 30 collecting the audio information output by the playback device, please refer to the relevant content described in the system embodiment given above, which will not be described in detail here.

[0057] When collecting the audio information output by the playback device, all of it can be collected; or, it can also be determined based on the interactive execution device to which it is connected to perform partial collection to improve the processing efficiency of subsequent audio data. For example, suppose a user is using a smart phone to watch a TV series, which includes the following three scenes: a pastoral play scene, a scene of searching for the source of a sudden odor, and a gunfight scene. If the processing device detects that only a communication connection is established with the vibrator, it can only collect and identify the audio information output by the above-mentioned "gunfight scene" played by the smart phone, and will not collect and identify the audio information output by the above-mentioned "pastoral play scene" and "sudden odor searching for the source scene" played by the smart phone. Based on this, the above-mentioned 101 "collecting audio information output by the playback device" can specifically include:

[0058] Collecting all audio information output by the playback device; or

[0059] Detecting the interactive execution device connected to the communication; determining the target scene for which audio collection is required according to the interactive execution device connected to the communication; and collecting the audio information output by the playback device that matches the target scene.

[0060] In the above 102, a relevant audio recognition algorithm may be used to identify and process the audio information, so as to determine whether the acquired audio information contains target audio that meets the requirements. That is, in an achievable technical solution, the above 102 "determining whether the audio information contains target audio that meets the requirements" may specifically include:

[0061] 1021. Perform feature extraction on the audio information to determine an audio type of at least one audio in the audio information;

[0062] 1022. When the audio type of some audios in the at least one audio is a preset audio type, determine that the audio information contains a target audio that meets a preset requirement.

[0063] In specific implementation, the audio information can be input into a pre-trained audio recognition model, and the audio recognition model can be executed to obtain an output result including the audio type of at least one audio in the audio information; wherein the pre-trained audio recognition model can be various machine learning models such as a deep learning model and a neural network model. Afterwards, the audio type of the at least one audio is matched with the preset audio type in the preset information; if the audio type of at least part of the at least one audio matches the preset audio type, it is determined that the audio information contains the target audio that meets the preset requirements.

[0064] Alternatively, other methods may be used to determine whether the audio information contains the target audio. For example, the relevant audio feature extraction algorithm may be directly used to extract features from the audio information to obtain the audio characteristics (such as spectrum characteristics, amplitude characteristics, etc.) of at least one audio in the audio information; then, the audio characteristics of at least one audio are matched with the preset audio characteristics in the audio library, wherein the matching can be achieved by calculating the similarity between the audio characteristics of at least one audio and the preset audio characteristics; if the audio characteristics of at least part of the audio in at least one audio match the preset audio characteristics in the audio library, for example, there is an audio feature of an audio a in at least one audio and a preset audio feature b in the audio library whose similarity is greater than or equal to a threshold, then it is determined that the audio information contains the target audio that meets the preset requirements. Furthermore, the audio type corresponding to the preset audio feature that matches the audio feature of the target audio can be obtained from the audio library as the audio type of the target audio for subsequent use.

[0065] That is, the above 102 "determining whether the audio information contains target audio that meets the requirements" can also be implemented by the following steps:

[0066] 1021', extracting features from the audio information to obtain audio features of at least one audio in the audio information;

[0067] 1022', matching the audio feature of the at least one audio with the preset audio feature in the audio library;

[0068] 1023': If the audio features of part of the at least one audio match the preset audio features in the audio library, determine that the audio information contains a target audio that meets the preset requirements.

[0069] Furthermore, the above 102 may also include the following steps:

[0070] An audio type corresponding to a preset audio feature matching the audio feature of the target audio is obtained from the audio library and determined as the audio type of the target audio.

[0071] It should be noted that the above audio information may include one or more (two or more) target audios that meet preset requirements, and this embodiment does not specifically limit the number of target audios.

[0072] In the above 103, the interactive information may include but is not limited to the interactive type and interactive parameters. For example, if the interactive type is light, the corresponding interactive parameters are light color, light intensity, etc. The interactive type can be determined according to the audio type of the target audio, and the interactive parameters are related to the audio characteristics (such as amplitude characteristics) of the target audio. Based on this, in an achievable technical solution, the "determining the interactive information corresponding to the target audio" in the above 103 may specifically include:

[0073] 1031. Determine an interaction type according to the audio type of the target audio;

[0074] 1032. Acquire audio features of the target audio obtained by extracting features from the audio information;

[0075] 1033. Determine an interaction parameter that has a corresponding relationship with the audio feature of the target audio according to the first corresponding relationship between the audio feature associated with the interaction type contained in the preset information and the interaction parameter.

[0076] In the above, an interaction type may be associated with at least one audio feature corresponding to the same audio type; wherein the associated audio feature may be a feature range or a specific audio feature, which is not limited here. Preferably, it is a feature range. If the audio feature of the target audio is within a certain audio feature range associated with the corresponding interaction type, then the interaction parameter having a corresponding relationship with the certain audio feature is also the interaction parameter having a corresponding relationship with the audio feature of the target audio.

[0077] For example, see Table 1 below, which shows some information (i.e., preset information) preset in advance for implementing the embodiments of the present application. Assuming that the target audio is a gunshot, and the interactive type corresponding to the gunshot is vibration, the vibration association in the preset information has multiple corresponding relationships between gunshot characteristics and vibration intensity. This is in consideration of the different gunshot characteristics (such as the size of the gunshot) that are usually produced by different types of guns. For this reason, a suitable vibration intensity is set for the corresponding association of different gunshot characteristics, which can facilitate giving the user adaptive interactive feedback. From the above, if the audio characteristics of the target audio are within the range of the gunshot characteristic a1, then the interactive parameter that has a corresponding relationship with the audio characteristics of the target audio is the vibration intensity b1, and the corresponding vibration device can be subsequently controlled to vibrate according to the vibration intensity b1 to give the user somatosensory feedback.

[0078] Table 1 Preset information

[0079]

[0080]

[0081] After determining the interactive information corresponding to the target audio frequency, the adapted interactive execution device can be determined and the corresponding interactive control instruction can be generated based on the interactive type and interactive parameters in the interactive information, so that the adapted interactive execution device can execute the interactive control instruction to generate the corresponding interactive action. That is, in an achievable technical solution, the above 104 "according to the interactive information, controlling the adapted interactive execution device to execute the corresponding interactive action" can specifically include the following steps:

[0082] 1041. Determine, according to a second correspondence between the interaction type contained in the preset information and the identifier of the interaction execution device, a target identifier having a correspondence with the interaction type in the interaction information;

[0083] 1042. Generate an interactive control instruction based on the interactive parameters in the interactive information;

[0084] 1043. Send the interactive control instruction to the target execution device corresponding to the target identifier, so that the interactive execution device corresponding to the target identifier responds to the interactive control instruction and performs a corresponding interactive action.

[0085] In specific implementation, the above-mentioned interactive execution device may include but is not limited to at least one of the following:

[0086] A first device disposed in a physical space, the first device being used to provide information perceptible to human vision. For example, the first device may include a lighting device for outputting lights of different colors and / or different brightnesses, a display device for presenting different screen contents, etc.;

[0087] A second device is arranged in the physical space, and is used to provide information that can be perceived by human hearing. For example, the second device can be a sound device such as a speaker or a microphone.

[0088] A third device is provided on the lying and sitting device located in the physical space for a human body to lie and sit, and is used to provide information perceptible to the human body by touch. For example, the third device may include a vibrator for outputting vibration information of different vibration intensities, a wind spraying device for spraying air to simulate wind, a water spraying device for spraying water to simulate rain, a snow machine for simulating snowfall, and the like.

[0089] A fourth device is arranged in the physical space, and is used to provide information perceptible to human olfactory sense. For example, the fourth device may include a gas diffusion device for outputting different odors, a purification device for purifying air, and the like.

[0090] The physical space may be, but is not limited to, a bedroom, a living room, a theater, etc. Considering that the bedroom is a physical space that people use for a long time, the physical space is preferably a bedroom in this embodiment. The lying and sitting device is any one of the following or a combination of at least two: a smart bed, a smart chair, and a smart sofa.

[0091] Accordingly, the interactive action includes but is not limited to at least one of the following:

[0092] Lighting equipment performs light output actions of different colors and / or different brightness, and display equipment performs different screen content presentation actions;

[0093] The sound-generating device performs sound-generating actions of different sound contents and / or different sound volumes;

[0094] The vibrator performs vibration actions of different vibration intensities;

[0095] The water spray device performs water spray actions with different water spray amounts, and can spray a certain amount of water mist on the user's face when performing the action;

[0096] The wind blowing device performs a wind blowing action simulating different wind intensities, and can blow wind of a certain intensity onto the user's face when performing the action;

[0097] The snow machine performs snowing actions that simulate different amounts of snow;

[0098] The gas diffuser performs different scents and / or different concentrations of gas diffusion actions;

[0099] Air purification actions performed by purification equipment, etc.

[0100] Through the above-mentioned various interactive execution devices, this embodiment can give users corresponding feedback from the human body's vision, hearing, touch, taste and smell for specific sound frequencies, so that users can achieve an immersive experience. Specifically, for example, through lighting equipment and display equipment, users can be given visual feedback experience for specific sound frequencies (such as rain sounds); through the above-mentioned vibrators, water spray devices, air spray devices and snow machines, users can be given physical (i.e. tactile) feedback for specific sound frequencies (such as gunshots, earthquakes, rain sounds, wind sounds, etc.); through gas diffusion equipment, users can be given olfactory feedback for specific sound frequencies (such as "It stinks" and "What smells so good" emitted by film and television characters in film and television works, and other similar sound frequencies related to smells), and so on.

[0101] When the lying and sitting device is a smart bed, the vibrator can be set under the mattress, and the water mist spray device, air spray device, snow machine, etc. can be set at the head of the bed. When the lying and sitting device is a smart chair or a smart sofa, the vibrator can be set under the seat cushion or sofa cushion, and the water mist spray device, air spray device, snow machine, etc. can be set at any position where the sprayed water mist, wind or snow can act on the user's face, which is not limited here.

[0102] For example, in combination with the example given in the above step 103, after the interaction type "vibration" determines that the interaction execution device is a vibrator and generates an interaction control instruction c based on the interaction parameter "vibration intensity b1", the interaction control instruction c will be sent to the vibrator set on the reclining device; the vibrator executes the interaction control instruction c and outputs the vibration intensity b1 to give physical feedback to the user sitting (or lying) on ​​the reclining device.

[0103] The technical solution provided in this embodiment determines whether the audio information collected from the playback device outputs the target audio that meets the requirements; and if the audio information contains the target audio that meets the requirements, it further determines the interactive information corresponding to the target audio, and controls the adapted interactive execution device to perform the corresponding interactive action according to the interactive information. It can be seen that this solution can provide users with interactive feedback adapted to a specific audio by using audio-related recognition technology. The solution is simple to implement, and it can also enhance the user experience when watching movies or playing games.

[0104] Based on the above content, the present application also provides several devices for lying down through the following embodiments. Specifically,

[0105] In one embodiment of the present application, a reclining device is provided. The reclining device comprises: a device body and a processing device; wherein:

[0106] A device body is located in the physical space; a part of the plurality of interactive execution devices is arranged on the device body, and the remaining part of the interactive execution devices is arranged in the physical space;

[0107] A processing device is arranged on the device body and is communicatively connected with the multiple interactive execution devices, and is used to collect audio information output by the playback device; determine whether the audio information contains target audio that meets the requirements; when the audio information contains target audio that meets the requirements, determine interactive information corresponding to the target audio; and control the adapted interactive execution device among the multiple interactive execution devices to perform corresponding interactive actions according to the interactive information.

[0108] Furthermore, the above-mentioned lying and sitting device is any one of the following or a combination of at least two: a smart bed, a smart chair, and a smart sofa.

[0109] In addition to implementing the above steps, the above processing device can also implement the relevant steps in other embodiments of the present application. For the specific implementation of the functions of the processing device, as well as the specific introduction of the interactive execution device and the physical space, please refer to the relevant content in other embodiments above, which will not be described in detail here.

[0110] In view of the situation where the above-mentioned lying and sitting device is a smart bed, another embodiment of the present application also provides a smart bed. Figure 3a and Figure 3b The structure diagram of the smart bed is shown in FIG. Figure 3a and Figure 3b As shown, the smart bed includes: a bed body 40 and a processing device (not shown in the figure); wherein,

[0111] A bed 40 is located in the physical space; a part of the plurality of interactive execution devices is arranged on the bed 40, and the remaining part of the interactive execution devices is arranged in the physical space;

[0112] The processing device is arranged on the bed 40 and is communicatively connected with the multiple interactive execution devices, and is used to collect audio information output by the playback device; determine whether the audio information contains target audio that meets the requirements; when the audio information contains target audio that meets the requirements, determine interactive information corresponding to the target audio; and control the adapted interactive execution device among the interactive execution devices to perform corresponding interactive actions according to the interactive information.

[0113] In addition to implementing the above steps, the above processing device can also implement related steps in other embodiments. For the specific implementation of the functions of the processing device, as well as the specific introduction of the interactive execution device and the physical space, please refer to the relevant content in other embodiments above, which will not be described in detail here.

[0114] It should be noted that the smart bed may include other components in addition to the bed body 40 and the processing device, such as a light strip (one of the lighting devices described above), an audio system (one of the sound devices described above), a screen system (one of the display devices described above), a projector (such as Figure 3a The projector 44 shown in FIG. 4 ), the control system corresponding to the interactive execution device, etc. Figure 3a or Figure 3bAs shown, the curtain system 43 may include a third drive component, a reel (not shown in the figure) and a curtain piece, etc. The curtain piece is rolled on the reel, and the third drive component is arranged on the bed frame 41. The third drive component is connected to the reel to drive the reel to rotate, and the curtain piece is unfolded or retracted as the reel rotates. The above-mentioned third drive component is connected to a corresponding control system, and the control system controls the start and stop of the third drive member, and the third drive member is configured with a third control button. When the user uses the smart bed to watch a movie, the third control button is pressed to start the third drive member, and the third drive component drives the reel to rotate, and the curtain piece is unfolded as the reel rotates until the curtain piece is fully unfolded. The user can watch a movie while lying on the bed to relax, or the game screen can be projected on the curtain when lying on the bed to play games, etc.; and when the user is watching a movie or playing a game, the solution provided by this application can also give the user somatosensory or visual feedback for specific audio frequencies in the film, television or game, etc., so as to improve the user's experience of watching a movie or playing a game, etc.

[0115] Among them, in a specific implementation method, Figure 3b As shown, the curtain system 43 can be arranged in the bed end 411, the third driving assembly includes a third driving member and a crossbar, the third driving member includes a third fixed end and a third driving end, the third fixed end is embedded in the bed end 411, the third driving end is connected to the crossbar, and the third driving member drives the crossbar to rise or fall. The roller is arranged on the bed frame 41, and the two ends of the curtain member are respectively connected to the roller and the crossbar.

[0116] In another specific implementation, Figure 3a As shown, a bed frame 41 may also be provided with a bedstead 42. The bedstead 42 includes at least two columns 421 and a crossbeam 422. The two columns 421 are respectively arranged on opposite sides of the bed foot 411 along the width direction of the bed frame, and the tops of the two columns 421 are respectively connected to the two ends of the crossbeam 422; the curtain system 43 is arranged on the bedstead 42, and the curtain piece can be unfolded or retracted relative to the crossbeam 422. Specifically, a reel may be provided on the crossbeam 422, and the reel may be embedded in the crossbeam 422 or arranged on the lower side of the crossbeam 422. The third driving member (not shown in the figure) may include a motor and a stopper, and the motor and the stopper are electrically connected. The motor is connected to one end of the reel, and the other end of the reel may be connected to the side wall of the crossbeam 422 or the column 421 through a bearing. One end of the curtain piece is connected to the reel tube, and the other end is provided with a counterweight rod 431. The motor drives the reel tube to rotate to drive the curtain piece to unfold or retract. The limiter is connected to the motor. The limiter and the motor are controlled by the control system. The rotation angle of the motor is calculated according to the maximum distance of the unfolding of the curtain piece to set the working threshold of the limiter. Furthermore, the two columns 421 are provided with grooves on one side close to the reel tube. The grooves are arranged along the length direction of the columns 421. Both sides of the curtain piece are located in the grooves. Noise reduction cotton can also be arranged in the grooves. When the curtain piece is unfolded or retracted, the two ends of the counterweight rod 431 move along the grooves to make the curtain flat.

[0117] For other components that the above-mentioned smart bed may include, please refer to the components that an existing smart bed may include, and no further details will be given here.

[0118] Accordingly, another embodiment of the present application further provides a physical space. The physical space includes: a playback device; and a lying device as provided in other embodiments of the present application;

[0119] Wherein, the lying and sitting device is any one of the following or a combination of at least two: a smart bed, a smart chair, and a smart sofa.

[0120] The physical space provided in this embodiment may be, but is not limited to, a bedroom space, a living room space, a theater space, etc. However, considering that the bedroom is the most frequently used physical space by people, the physical space in this embodiment is preferably a bedroom.

[0121] Several scenarios are listed below to introduce and illustrate the technical solutions provided by the following embodiments of the present application.

[0122] Scenario 1: The user's smartphone has an application software corresponding to the smart bed installed on it. The program corresponding to the application software includes a processing device 30, that is, the processing device 30 is a software device, specifically a set of computer programs. Figure 3a or Figure 3b As shown, a curtain system, some interactive execution devices such as a vibrator installed under the mattress, a water spray device at the head of the bed, an air spray device, an odor diffusion device on the bed, a purification device (for purifying the space), and lighting devices (such as light strips) are installed on it; the above-mentioned lighting devices such as light strips can be specifically set at the head of the bed, or the bed frame or Figure 3a The bed frame 42 etc. shown are not limited here.

[0123] After get off work, the user returns to the bedroom and lies on the smart bed to rest. During the rest period, the user uses the screen system on the smart bed to watch movies, wherein the movies projected on the screen system are provided by the smart phone used by the user. Specifically, the user can connect the smart phone to the projector set on the smart bed to project the picture content of the movie on the screen through the projector; in addition, the audio corresponding to the movie can be obtained by the processing device 30, and can also be played through the speakers on the smart bed. Assume that the current movie scene that the user is watching is: gunfight in the rain. After the processing device 30 performs feature analysis on the audio information corresponding to the collected movie plot, it is determined that the audio information contains the audio: rain sound, gunshot, and human voice; the determined rain sound, gunshot, human voice and other audio are matched with the preset audio type, and the rain sound and gunshot match the preset audio type, which is the target audio. Further, in combination with Table 1 given in other embodiments above, the corresponding interaction type and device identification of the interaction execution device for the gunshot are vibration and identification 1 respectively; and the corresponding interaction type and device identification of the interaction execution device for the rain sound are light and identification 2 respectively; and based on the audio characteristics of the rain sound, the rainfall is determined to be within the range of rainfall c1, and based on the audio characteristics of the gunshot sound, the gunshot sound characteristics (such as the gunshot sound volume) are determined to be within the range of the gunshot sound characteristics a1. Therefore, in combination with Table 1, the corresponding interaction parameter for the gunshot sound can be determined to be vibration intensity b1, and the corresponding interaction parameter for the rain sound can be determined to be cold light brightness d1. After obtaining the above information, further, the processing device 30 will execute the generation of interaction control instruction 1 according to the interaction parameter "vibration intensity b1", and send the interaction control instruction 1 to the interaction execution device (i.e., vibrator) corresponding to identification 1; and generate interaction control instruction 2 according to the interaction parameter "cold light brightness d1", and send the interaction control instruction 2 to the interaction execution device (i.e., lighting device) corresponding to identification 2. After the vibrator responds to the interactive control instruction 2, it will vibrate according to the vibration intensity b1, so as to give the user physical feedback on the gunshot. After the lighting device responds to the interactive control instruction 2, it will adjust the light color to a cool color with a certain brightness, such as adjusting the light color to cyan, green, etc., so as to give the user visual feedback, so that the user can visually feel the coldness of the rainy day in the film and television scene; wherein, the greater the rainfall, the lower the brightness of the cool color.

[0124] Furthermore, assuming that the user is watching a video scene that switches from the above-mentioned "gunfight in the rain" scene to the "sudden smell of bad smell looking for the source" scene, the processing device 30 performs feature analysis on the collected audio information corresponding to the "sudden smell of bad smell looking for the source" scene, such as "What's that smell, it stinks!", and can determine the corresponding interactive parameter as: diffuse a preset amount of odorous gas, and according to the above-determined interactive parameter, the odor diffuser can be controlled to diffuse a preset amount of odorous gas, so as to give the user olfactory feedback, so that the user can visually feel the odor in the above-mentioned video scene. Afterwards, if it is subsequently monitored that the video scene switches from the above-mentioned "sudden smell of bad smell looking for the source" scene to another scene that is not related to odor, the purification device can also be controlled to purify the odor in the air to restore the air in the bedroom to a fresh state.

[0125] Furthermore, assuming that the film or TV scene watched by the user switches to a scene where a mouse is discovered, the processing device 30 performs feature analysis on the collected audio information corresponding to the scene, such as "Ah, there is a mouse, a mouse, a mouse...", and can control the sound-emitting device to emit audio that simulates the sound of a mouse to give the user auditory feedback, so that the user can hear the presence of mice around the film and TV characters in the film or TV scene.

[0126] As can be seen from the above, when the user lies on the smart bed to rest and uses the screen system on the smart bed to watch a movie, the technical solution provided in this application can target specific sound frequencies in the film and television (such as rain, gunshots, wind, sounds related to smells, etc.) and give the user physical, visual, olfactory, auditory, etc. feedback through adaptive interactive execution devices, thereby making the user feel immersive and enhancing the user's viewing experience.

[0127] It should be noted that when the processing device 30 sends the corresponding interactive control instruction to the corresponding interactive instruction device, it can be sent to the control system corresponding to the interactive execution device set on the smart bed, and the control system controls the corresponding interactive execution device to perform the corresponding interactive action according to the interactive control instruction. For example, for the interactive control instruction 2 in the above example, the processing device 30 can send the interactive control instruction 2 to the lighting control system arranged on the smart bed, and the lighting control system controls the lighting device to adjust the light color to a cool color with a certain brightness.

[0128] Scenario 2: The processing device 30 is a hardware device, deployed in Figure 3a or Figure 3b The smart bed shown (not shown in the figure) is equipped with some interactive execution devices, such as a vibrator installed under the mattress, a water mist spray device and an air spray device at the head of the bed; in addition, there are some interactive execution devices, such as lighting equipment, installed in the bedroom where the smart bed is located.

[0129] When a user is lying on the smart bed and playing games with a smart phone, the processing device 30 installed on the smart bed is started, and the microphone inside the smart bed is used to collect the game audio information played by the user during the game, and the collected game audio information is processed to determine whether it contains target audio, such as gunshots, base collapse sounds, etc., and further determine the corresponding interaction parameters such as gunshots, base collapse sounds, etc., so as to control the adapted interaction execution equipment such as a vibrator to execute the corresponding interaction actions according to the interaction parameters.

[0130] The user lies on the smart bed to rest. During the game, the technical solution provided by the present application can provide the user with physical and / or visual feedback through the adapted interactive execution device for the specific sound frequency in the game, which can enhance the user's gaming experience.

[0131] For the specific implementation of determining the corresponding interaction parameters as described above, controlling the adapted interaction execution device such as a vibrator to perform the corresponding interaction actions according to the interaction parameters, etc., please refer to the relevant content in the above scenario one or other embodiments of the present application.

[0132] Accordingly, an embodiment of the present application further provides a computer-readable storage medium storing a computer program, and when the computer program is executed by a computer, the interactive method steps or functions provided in the above-mentioned embodiments can be implemented.

[0133] The method in the present application may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it may be implemented in whole or in part in the form of a computer program product. Figure 4 A block diagram of a computer program product provided by the present application is schematically shown. The computer program product includes a computer program / instruction 50. When the computer program / instruction 1011 is executed by a processing unit such as a processor, the process or function in the interactive method provided by each embodiment of the present application can be fully or partially executed. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user device, a core network device, an OAM or other programmable device.

[0134] The computer program or instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer program or instructions may be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired or wireless means. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium may be a magnetic medium, such as a floppy disk, a hard disk, or a magnetic tape; it may also be an optical medium, such as a digital video disk; it may also be a semiconductor medium, such as a solid-state drive. The computer-readable storage medium may be a volatile or non-volatile storage medium, or may include both volatile and non-volatile types of storage media.

[0135] Through the description of the above implementation modes, those skilled in the art can clearly understand that each implementation mode can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on such an understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0136] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. An interactive method, characterized in that: include: Collect audio information output by the playback device; Determining whether the audio information contains target audio that meets the requirements; When the audio information contains a target audio that meets the requirements, determining interactive information corresponding to the target audio; According to the interaction information, the adapted interaction execution device is controlled to execute corresponding interaction actions.

2. The method according to claim 1, characterized in that Determining whether the audio information contains target audio that meets the requirements includes: Performing feature extraction on the audio information to determine an audio type of at least one audio in the audio information; When the audio type of some of the at least one audio is a preset audio type, it is determined that the audio information contains a target audio that meets the preset requirement.

3. The method according to claim 2, characterized in that The interaction information includes: interaction type and interaction parameters; and Determining interactive information corresponding to the target audio frequency includes: Determining an interaction type according to the audio type of the target audio; Acquiring audio features of the target audio obtained by extracting features from the audio information; According to the first correspondence between the audio feature associated with the interaction type and the interaction parameter, an interaction parameter having a correspondence with the audio feature of the target audio is determined.

4. The method according to claim 3, characterized in that According to the interaction information, controlling the adapted interaction execution device to execute corresponding interaction actions includes: Determine, according to a second correspondence between the interaction type and the identifier of the interaction execution device, a target identifier that has a correspondence with the interaction type in the interaction information; Generate an interactive control instruction based on the interactive parameters in the interactive information; The interactive control instruction is sent to the interactive execution device corresponding to the target identifier, so that the interactive execution device corresponding to the target identifier responds to the interactive control instruction and performs a corresponding interactive action.

5. The method according to any one of claims 1 to 4, characterized in that The interactive execution device includes at least one of the following: A first device disposed in the physical space, for providing information perceptible to human vision; A second device disposed in the physical space, for providing information perceptible to human hearing; A third device is provided on a lying device located in the physical space and capable of being lied on by a human body, and is used for providing information perceptible to the human body by sense of touch; A fourth device is disposed in the physical space to provide information perceptible to human olfactory sense.

6. The method according to claim 5, characterized in that The interactive action includes at least one of the following: The first device performs light output actions of different colors and / or different brightness, and different screen content presentation actions; The second device performs a sound emitting action with different sound contents and / or different sound volumes; The third device performs vibration actions of different vibration intensities, water spraying actions of different water spraying amounts, and wind blowing actions simulating different wind blowing intensities; The fourth device performs gas diffusion actions and air purification actions of different concentrations and / or different odors.

7. The method according to claim 5, characterized in that The lying and sitting device is one of the following or a combination of at least two: a smart bed, a smart chair, and a smart sofa.

8. An interactive system, characterized in that: include: Playback device; Interactive execution equipment; A processing device, connected to the playback device and the interactive execution device for collecting audio information output by the playback device; Determine whether the audio information contains target audio that meets the requirements; if the audio information contains target audio that meets the requirements, determine interactive information corresponding to the target audio; and control the adapted interactive execution device to execute corresponding interactive actions according to the interactive information.

9. A lying device, characterized in that: include: A device body is located in the physical space; a part of the plurality of interactive execution devices is arranged on the device body, and the remaining part of the interactive execution devices is arranged in the physical space; A processing device, arranged on the device body, is communicatively connected with the plurality of interactive execution devices, and is used to collect audio information output by the playback device; Determine whether the audio information contains target audio that meets the requirements; if the audio information contains target audio that meets the requirements, determine interactive information corresponding to the target audio; and control an adapted interactive execution device among the multiple interactive execution devices to perform corresponding interactive actions according to the interactive information.

10. The method according to claim 9, characterized in that The lying and sitting device is one of the following or a combination of at least two: a smart bed, a smart chair, and a smart sofa.

11. A smart bed, characterized in that: include: A bed body is located in the physical space; a part of the plurality of interactive execution devices is arranged on the bed body, and the remaining part of the interactive execution devices is arranged in the physical space; A processing device, disposed on the bed, and connected to the plurality of interactive devices for collecting audio information output by the playback device; Determine whether the audio information contains target audio that meets the requirements; if the audio information contains target audio that meets the requirements, determine interactive information corresponding to the target audio; and control the adapted interactive execution device to perform corresponding interactive actions according to the interactive information.

12. A physical space, characterized in that: include: Playback device; as well as A lying device as claimed in claim 9 or 10; Wherein, the lying and sitting device is one of the following or a combination of at least two: a smart bed, a smart chair, and a smart sofa.

Images