Adjustable multimedia system and control method thereof

Abstract

The present application relates to the technical field of multimedia integration, and the present application provides an adjustable multimedia system and a control method thereof. The adjustable multimedia system provided in the present application includes: a first base, a control device, a first lifting mechanism and a display screen; wherein the first lifting mechanism is equipped with a first driving device, and an information acquisition module is provided on the display screen; the display screen is installed on the first base through the first lifting mechanism; the control device is connected to the information acquisition module on the display screen, and is connected to the first driving device; the control device receives the acquisition data of the information acquisition module, outputs a lifting adjustment signal to the first driving device, and adjusts the height position of the display screen. The solution provided in the present application can quickly adapt to different usage modes according to changes in usage requirements.

Description

Technical Field

[0001] The present application relates to the technical field of multimedia integration, and in particular, to an adjustable multimedia system and a control method thereof. Background Art

[0002] In response to the different adaptation requirements of multimedia devices, manufacturers provide combination designs that can be suitable for different usage scenarios. For example, when providing multimedia devices, different bracket bases are provided or reserved holes for different installation methods are set on the multimedia devices so that users can choose to install them.

[0003] However, the current combination design makes the application scenario of the multimedia device single, and it is impossible to quickly switch to the corresponding use state according to the change of the scenario, and thus it is impossible to provide the best use effect according to the switching of the use state. Summary of the invention

[0004] In order to improve the optimal use effect of the multimedia system as mentioned above, the present application provides an adjustable multimedia system and a control method thereof.

[0005] In a first aspect, the adjustable multimedia system provided by the present application comprises:

[0006] A first base, a control device, a first lifting mechanism and a display screen; wherein the first lifting mechanism has a built-in first driving device, and the display screen is provided with an information collection module;

[0007] The display screen is installed on the first base through the first lifting mechanism; the control device is connected to the information acquisition module on the display screen and is connected to the first driving device;

[0008] The control device receives the collected data from the information collection module, outputs a lifting adjustment signal to the first driving device, and adjusts the height position of the display screen.

[0009] In an optional embodiment of the first aspect, the adjustable multimedia system further comprises:

[0010] An audio playback device, a second base, and a second lifting mechanism;

[0011] The audio player device is installed on the second base through the second lifting mechanism; the second lifting mechanism is equipped with a second driving device, which is connected to the control device and adjusts the height position of the audio player device under the control of the control device.

[0012] In an optional embodiment of the first aspect, at least one foldable support foot is further provided on the back of the display screen, and a flip structure is provided at the connection between the first lifting mechanism and the display screen;

[0013] The flip structure is connected to the control device and flips under the control of the control device. The supporting legs are opened and support the display screen, so that the display screen is placed flat or tilted on the ground.

[0014] In an optional embodiment of the first aspect, the first lifting mechanism is connected to the display screen via a rotating structure, the rotating structure is connected to the control device, and the rotation angle of the display screen is adjusted under the control of the control device.

[0015] In an optional embodiment of the first aspect, the information acquisition module includes a camera installed above the display screen, which is used to capture an image in front of the display screen and output it to the control device.

[0016] In an optional embodiment of the first aspect, a guide rail is further provided above the display screen, the information acquisition module further includes a driving component connected to the camera, and the camera is connected to the guide rail through the driving component;

[0017] The driving component is connected to the control device, and drives the camera to slide on the guide rail under the control of the control device to adjust the shooting position of the camera.

[0018] In an optional embodiment of the first aspect, the information acquisition module further includes a microphone, which detects external sound information and outputs the sound information to the control device.

[0019] In a second aspect, based on the adjustable multimedia system provided in the first aspect, a control method is provided, which comprises the following steps:

[0020] Performing face recognition on the image captured by the camera, identifying the user speaking in front of the display screen according to the face image, and determining the real-time relative position of the head of the speaking user in the image;

[0021] Obtaining control signals of height and horizontal position according to the real-time relative position;

[0022] The control signal is output to drive the first driving device and the driving component to slide on the guide rail, and the height and horizontal position of the camera are controlled so that the head position of the speaking user and the camera are always in the same axis state for shooting.

[0023] In an optional embodiment of the second aspect, the control method further includes:

[0024] Analyze the frequency of the sound information, determine multiple speaking users in front of the display screen according to the frequency of the sound information, and obtain a sound clip of each speaking user and its first timestamp;

[0025] Performing face recognition on the image captured by the camera, identifying the speaker in front of the display screen according to the face image, and recording the real-time relative position of each speaker in the image and its corresponding second timestamp;

[0026] The first timestamp is matched with the second timestamp, and a target speaking user is determined from among the speaking users.

[0027] In an optional embodiment of the second aspect, the control method further includes:

[0028] Detect whether the camera is beyond the range of the guide rail axis. If so, perform AI processing on the captured image and place the captured image of the speaking user in the center of the image screen.

[0029] The adjustable multimedia system and control method provided by the present application have the following beneficial effects:

[0030] The adjustable multimedia system provided by the present application can automatically adjust to the corresponding usage state according to the switching of the usage scene, and can quickly adapt to different usage modes. At the same time, the control device can control the adjustment mechanism including the first lifting mechanism with the help of the data collected by the information collection module, so as to provide the user with the best usage effect in each usage mode.

[0031] In addition, based on the control method of the above-mentioned adjustable multimedia system, the present application can, for the current usage scenario, identify the speaking user according to the facial recognition information and / or corresponding sound information obtained for each user, and obtain the real-time relative height position and horizontal position of the user's head in the image, so that the head position of the speaking user is always in the same axis state as the camera, which helps to obtain better shooting effects for the speaking user.

[0032] Additional aspects and advantages of the present application will be partially given in the following description, which will become obvious from the following description, or will be learned through practice. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] The above and / or additional aspects and advantages will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0034] Figure 1 A schematic diagram of a usage state structure of an adjustable multimedia system provided by an embodiment of the present application;

[0035] Figure 2 A schematic diagram of the structure of a first lifting mechanism 30 provided in one embodiment of the present application;

[0036] Figure 3aA schematic diagram of a structure of a use state when the first lifting mechanism 30 of the adjustable multimedia system provided by one embodiment of the present application is a single-rod lifting mechanism;

[0037] Figure 3b A schematic structural diagram of another use state of the first lifting mechanism 30 of the adjustable multimedia system provided by one embodiment of the present application when the first lifting mechanism 30 is a single-rod lifting mechanism;

[0038] Figure 4 A schematic diagram of the structure of an adjustable multimedia system provided by an embodiment of the present application;

[0039] Figure 5 A structural schematic diagram of another usage state of an adjustable multimedia system provided by an embodiment of the present application;

[0040] Figure 6 A schematic diagram of the structure of an adjustable multimedia system provided by an embodiment of the present application;

[0041] Figure 7a A structural schematic diagram of a use state of an adjustable multimedia system provided by an embodiment of the present application;

[0042] Figure 7b A structural schematic diagram of a use state of an adjustable multimedia system provided by an embodiment of the present application;

[0043] Figure 7c A structural schematic diagram of a use state of an adjustable multimedia system provided by an embodiment of the present application;

[0044] Figure 8 A flowchart of a control method for an adjustable multimedia system provided by an embodiment of the present application;

[0045] Fig. 9 A flowchart of a control method for an adjustable multimedia system provided by another embodiment of the present application;

[0046] Fig.10 A schematic diagram of the structure of a control device for an adjustable multimedia system provided by an embodiment of the present application;

[0047] Fig.11 A schematic diagram of the structure of an electronic device controlled by an adjustable multimedia system provided by an embodiment of the present application. DETAILED DESCRIPTION

[0048] The present application will be further described below in conjunction with the accompanying drawings and exemplary embodiments, wherein the same reference numerals in the accompanying drawings all refer to the same components. In addition, if the detailed description of the known technology is not necessary for illustrating the features of the present application, it will be omitted.

[0049] Reference Figure 1 , 2 , Figure 1 A schematic diagram of a structure of an adjustable multimedia system in a usage state provided by an embodiment of the present application. Figure 2 A schematic structural diagram of a first lifting mechanism 30 provided in one embodiment of the present application.

[0050] The present application provides an adjustable multimedia system that can automatically switch to corresponding usage states according to different usage requirements.

[0051] The adjustable multimedia system at least comprises a first base 10, a control device (not shown), a first lifting mechanism 30 and a display screen 20. The first lifting mechanism 30 is equipped with a first driving device, and an information acquisition module is provided on the display screen 20. The display screen 20 can be a multi-point touch screen, which can receive user instructions through the screen.

[0052] The first base 10 is located at the bottom of the entire adjustable multimedia system and is directly placed on the ground to support the entire adjustable multimedia system. The display screen 20 is installed on the first base 10 through a first lowering mechanism, and the first lowering mechanism plays a role in height adjustment and support for the display screen 20. The first lowering mechanism drives and controls the first driving device through the control device to achieve the purpose of automatic lifting of the display screen 20.

[0053] The first lifting mechanism 30 shown can be a single-rod lifting mechanism or a double-rod lifting mechanism.

[0054] Reference Figure 3a-3b , Figure 3a A schematic diagram of a structure of a use state when the first lifting mechanism 30 of the adjustable multimedia system provided by one embodiment of the present application is a single-rod lifting mechanism; Figure 3b A structural schematic diagram of another use state of the first lifting mechanism 30 of the adjustable multimedia system provided by one embodiment of the present application when the first lifting mechanism 30 is a single-rod lifting mechanism.

[0055] like Figure 3a-3b As shown, when the first lifting mechanism 30 is a single-rod lifting mechanism, the end of the connecting rod of the first lifting mechanism 30 is connected to the middle position of the back of the display screen 20, supporting the display screen 20, and pushing the display screen 20 to perform lifting movement under the control of the first driving device.

[0056] In this embodiment, the first lifting mechanism 30 is connected to the display screen 20 via a rotating structure (not shown). Specifically, the connecting rod of the first lifting mechanism 30 is connected to the display screen 20 via the rotating structure. The rotating structure is connected to the control device. When the adjustable multimedia system is used, the rotating structure automatically adjusts its angle by receiving a rotation command issued by the user and drives the display screen 20 connected thereto to rotate and switch to another use state, such as Figure 3a and Figure 3b The rotation instruction can be generated and sent by the user through an auxiliary device of the adjustable multimedia system such as a remote control device.

[0057] When the first lifting mechanism 30 is a double-rod lifting mechanism, the double connecting rods of the lifting mechanism are respectively installed on both sides of the display screen 20 to clamp and fix the display screen 20. The double-rod lifting mechanism can push the display screen 20 to perform lifting motion under the control of the first driving device.

[0058] The control device is connected to the information collection module to receive the collected data of the information collection module. According to the collected data, the control device outputs a corresponding lifting adjustment signal to the first driving device to adjust the height position of the display screen 20.

[0059] like Figure 2 As shown, a double-rod lifting mechanism is used as an example for explanation. The first driving device is a lifting motor 31 connected to the double connecting rods 32 respectively, and the lifting motor 31 includes a driving shaft 33. In this embodiment, the double connecting rods 32 are all configured as U-shaped grooves. The top of the driving shaft 33 is fixed in the U-shaped groove. Under the control of the lifting adjustment signal sent by the control device, the lifting motor 31 pushes the double connecting rods 32 to perform lifting movement through the driving shaft 33, thereby realizing the lifting adjustment of the display screen 20 clamped and fixed by the double connecting rods 32.

[0060] Reference Figure 4 , Figure 4 A schematic diagram of the structure of an adjustable multimedia system provided in one embodiment of the present application.

[0061] The adjustable multimedia system provided in the present application further includes an audio playback device 40 , a second base 50 and a second lifting mechanism 60 .

[0062] In this embodiment, the second base 50 and the first base 10 are located at the bottom of the structure supporting the audio player 40 and are directly placed on the ground. The audio player 40 is installed on the second base 50 through the second lifting mechanism 60. Figure 4 As shown, the audio playback device 40 can be disposed on both sides of the display screen 20 .

[0063] The audio playback device 40 is installed on the second base 50 via a second lifting mechanism 60. The second lifting mechanism 60 has a second driving device (not shown) built in. The second driving device is driven and controlled by the control device to achieve the purpose of automatic lifting of the display screen 20.

[0064] The second driving device is connected to the control device. The control device outputs a lifting adjustment signal to the second driving device according to the collected data of the information collection module, and the second driving device adjusts the height position of the audio playback device 40 under the control of the lifting adjustment signal of the control device. The lifting adjustment signal output to the second driving device can be consistent with the lifting adjustment signal output to the second driving device, so as to synchronously adjust the height of the display screen 20 and the audio playback device 40.

[0065] The second lifting mechanism 60 also includes a connecting piece (not shown) connected to the bottom of the audio player 40. The second driving device can be a lifting motor connected to the connecting piece, and the lifting motor includes a driving shaft. Under the control of the lifting adjustment signal sent by the control device, the second lifting motor drives the audio player 40 to be lifted and lowered through the driving shaft.

[0066] In addition, the second base 50 can form an integral base structure with the first base 10, which helps to increase the stability of the entire adjustable multimedia system. Alternatively, the second lifting mechanism 60 can be directly connected to the first driving device, and under the control of the first driving device, the audio playback device 40 and the display screen 20 can be lifted and lowered synchronously.

[0067] Reference Figure 5 , Figure 5 A structural schematic diagram of another usage state of an adjustable multimedia system provided by an embodiment of the present application.

[0068] In the adjustable multimedia system provided in the present application, at least one foldable support foot 70 is further provided on the back of the display screen 20, and a flip structure (not shown) is provided at the connection between the first lifting mechanism 30 and the display screen 20. The flip structure is connected to the control device. When receiving a switching instruction corresponding to the usage state from the user, the flip structure flips under the control of the control device. At the same time, the support foot 70 opens and plays a supporting role together with the first lifting mechanism 30, so that the display screen 20 is placed flat or tilted on the ground, and can be switched between a variety of usage states, and can be applied to a variety of usage modes such as conference discussion, information display, and games. Figure 5In this embodiment, two foldable support legs 70 are provided at the top corners of the back of the display screen 20. When the flip structure at the connection between the first lifting mechanism 30 and the display screen 20 is flipped until the two support legs 70 are supported on the ground, the support legs 70 and the first lifting mechanism 30 support the display screen 20 in a manner that is roughly parallel to the ground, and the user can play games on the flat display screen 20. The angle of the display screen 20 relative to the ground after the flip structure is flipped may depend on the height position reached by the lifting of the first lifting mechanism 30. If the height position is equal to the length of the support legs 70, the display screen 20 is flat on the ground; if they are not equal, the display screen 20 is tilted on the ground. At this time, the display screen 20 can be used as an information display panel for information display.

[0069] Reference Figure 6 , Figure 6 A schematic diagram of the structure of an adjustable multimedia system provided in one embodiment of the present application.

[0070] For the above embodiment, the adjustable multimedia system provided by the present application may further include a camera 80. The camera 80 is an information acquisition module, which is installed above the display screen 20 and connected to the control device to capture the image in front of the display screen 20 and output it to the control device.

[0071] In this embodiment, the camera 80 can be connected in a remote conference, obtain the on-site conference image, and transmit it to other connected users through a network connection. The camera 80 can also capture the on-site conference image. Through the conference image, especially the expression changes, movements and real-time relative position of each user in each frame of the image, it is possible to identify whether the current user is a speaking user. Specifically, the control device can identify the head position of each user in each frame of the image acquired by the camera 80. The real-time relative position of the mouth is further confirmed based on the real-time relative position of the head, and whether the user is in a speaking state is confirmed based on information such as the frequency of changes of the mouth in each frame of the image and the duration of the changes. In this embodiment, the changes in the mouth in the image may include the opening and closing state of the mouth.

[0072] In addition, the control device can also combine the recognition result of the real-time relative position of each user's head to obtain whether each user is in a standing or sitting state, and further determine whether the corresponding user is a speaking user.

[0073] When the speaking user is confirmed, a corresponding lifting adjustment signal is generated and sent to the first driving device according to the real-time relative position of the speaking user's head in the image, and the height of the camera 80 is adjusted so that the camera 80 can focus on the speaking user to shoot a clearer shooting effect. In this embodiment, the real-time relative position can be expressed as a coordinate value.

[0074] In the above embodiment, the information acquisition module further includes a driving component (not shown) connected to the camera 80 , and the camera 80 is connected to a guide rail 90 through the driving component. The guide rail 90 is located above the display screen 20 .

[0075] According to the real-time relative position of the head of the speaking user in the image by the camera 80, the corresponding horizontal position is obtained. According to the horizontal position, it is judged that the head image of the speaking user is not in the middle position of the camera range, which affects the shooting effect of the speaking user. Referring to the middle position information of the camera range, a movement adjustment signal is formed for the current horizontal position of the head of the speaking user. The control device sends the movement adjustment signal to the driving component. The driving component moves along the guide rail 90 according to the movement adjustment signal, so that the head image of the speaking user moves to or close to the middle position of the camera range, which helps to improve the shooting effect of the speaking user.

[0076] When the speaking user is confirmed, the control device sends a lifting adjustment signal and a moving adjustment signal to the first drive device and the drive component according to the real-time relative position of the speaking user, so as to control the height and horizontal position of the camera 80 so that the head position of the speaking user and the camera 80 are always in the same axis state for shooting.

[0077] Based on the above embodiments, the adjustable multimedia system provided by the present application further includes a microphone (not shown). The microphone is used to detect external sound information and output the sound information to the control device so that the control device can control the adjustable structure of the adjustable multimedia system.

[0078] The microphone can obtain sound information of the current environment, including the sound information of the user. The control device receives and analyzes the sound information obtained by the microphone, obtains that the sound information includes speech sounds of multiple frequencies, and obtains a judgment result that there are currently multiple speaking users. According to the judgment result, each sound frequency and sound segment and its corresponding first timestamp are obtained.

[0079] In this embodiment, the microphone is a matrix microphone.

[0080] Furthermore, the control device obtains information on the duration of the mouth image change in each frame image of the user identified as the speaker, and obtains a second timestamp corresponding to the speaking time period of the speaker.

[0081] According to the above embodiment, the first timestamp and the second timestamp corresponding to the speaking user are obtained through the camera 80 and the microphone, and the control device matches the first timestamp and the second timestamp, that is, the start and end time points of each sound segment in the first timestamp are matched one by one with the start and end time points of the speaking user obtained by image judgment in the second timestamp, and the speaking user who can be matched is confirmed as the target speaking user.

[0082] The control device obtains the real-time relative position of the corresponding head image based on the confirmed target speaking user, sends a lifting adjustment signal and a moving adjustment signal to the first driving device and the driving component, controls the height and horizontal position of the camera 80, and ensures that the head position of the speaking user and the camera 80 are always in the same axis state for shooting.

[0083] After adjusting the shooting position of the camera 80 in the above embodiment, the control device detects whether the camera 80 exceeds the axis range of the guide rail 90. If the axis range of the guide rail 90 is detected, the shooting effect of the user who speaks will be affected. Therefore, if it exceeds the axis range of the guide rail 90, the shooting image of the user who speaks is processed by AI, and the shooting image of the user who speaks is placed in the middle of the image screen of the display screen 20.

[0084] Reference Figure 7a-7c , Figure 7a-7c They are schematic diagrams of structures of an adjustable multimedia system in different usage states provided by an embodiment of the present application.

[0085] like Figure 7a As shown, the adjustable multimedia system provided by the present application includes a shelf 11 placed on the first base 10, and the shelf 11 is arranged in the middle of the two connecting rods 32 of the first lifting mechanism 30. And / or, Figure 7b As shown, the adjustable multimedia system may include a shelf 12 clamped between two connecting rods 32. Figure 7c As shown, the adjustable multimedia system may include an advertising screen 21 disposed above a display screen 20 , and the advertising screen 21 may be composed of a plurality of advertising screens 22 .

[0086] The adjustable multimedia system provided in the present application can automatically adjust to a corresponding usage state according to the switching of usage scenarios, and can quickly adapt to different usage modes. At the same time, the control device can control the adjustment mechanism including the first lifting mechanism with the help of the data collected by the information collection module, so as to provide the user with the best usage effect in each usage mode.

[0087] Reference Figure 8 , Figure 8 A flowchart of a control method for an adjustable multimedia system provided in one embodiment of the present application.

[0088] In the present application, based on the adjustable multimedia system involved in the above embodiment, a corresponding control method is provided. The control method comprises the following steps:

[0089] S810, performing face recognition on the image captured by the camera 80, identifying the speaking user in front of the display screen 20 according to the face image, and determining the real-time relative position of the speaking user's head in the image;

[0090] S820, obtaining a control signal of a height and a horizontal position according to the real-time relative position;

[0091] S830, output the control signal to drive the first driving device and the driving component to slide on the guide rail 90, control the height and horizontal position of the camera 80, so that the head position of the speaking user and the camera 80 are always in the same axis state for shooting.

[0092] In steps S810-S830, the control device can identify whether the current user is a speaking user based on the expression changes, actions and real-time relative position of the user in each frame of image acquired by the camera 80. More specifically, the control device can identify the head position of each user in each frame of image acquired by the camera 80. The real-time relative position of the mouth is further confirmed based on the real-time relative position of the head, and whether the user is in a speaking state is confirmed based on information such as the change frequency and duration of the mouth in each frame of image. In this embodiment, the change of the mouth in the image may include the opening and closing state of the mouth.

[0093] Furthermore, the corresponding height position and horizontal position are obtained according to the real-time relative position of the head of the speaking user in the image by the camera 80. According to the position information, a corresponding control signal is generated. The control signal includes sending a lifting adjustment signal and a moving adjustment signal to the first driving device and the driving component, respectively controlling the first driving device to adjust the height of the display screen 20 to adjust the height position of the camera 80, and controlling the driving component to drive the camera 80 to slide on the guide rail 90 to adjust the horizontal position of the camera 80. After the above control and adjustment, the head position of the speaking user and the camera 80 are always in the same axis state for shooting, so as to achieve the best shooting effect.

[0094] Reference Fig. 9 , Fig. 9 A flowchart of a control method for an adjustable multimedia system provided in another embodiment of the present application.

[0095] When there are multiple current speakers, the control method may further include:

[0096] S910, analyzing the frequency of the sound information, determining multiple speaking users in front of the display screen 20 according to the frequency of the sound information, and obtaining a sound clip of each speaking user and its first timestamp;

[0097] S920, performing face recognition on the image captured by the camera 80, identifying the speaking user in front of the display screen 20 according to the face image, and recording the real-time relative position of each speaking user in the image and its corresponding second timestamp;

[0098] S930: Match the first timestamp with the second timestamp, and determine a target speaking user from the speaking users.

[0099] Reference Fig. 9 , Fig. 9 A flowchart of a control method for an adjustable multimedia system provided in another embodiment of the present application.

[0100] According to the above steps S910-S930, the technical solution formed is as follows Fig. 9 shown.

[0101] In steps S910-S930, the control device receives and analyzes the sound information of the environment of the microphone, including the user's sound information, obtains the sound information includes speech sounds of multiple frequencies, and obtains the judgment result that there are currently multiple speaking users. According to the judgment result, each sound frequency and sound segment and its corresponding first timestamp are obtained.

[0102] Furthermore, the control device obtains information on the duration of the mouth image change in each frame image of the user identified as the speaker, and obtains a second timestamp corresponding to the speaking time period of the speaker.

[0103] According to the above embodiment, the first timestamp and the second timestamp corresponding to the speaking user are obtained through the camera 80 and the microphone, and the control device matches the first timestamp and the second timestamp, that is, the start and end time points of each sound segment in the first timestamp are matched one by one with the start and end time points of the speaking user obtained by image judgment in the second timestamp, and the speaking user who can be matched is confirmed as the target speaking user.

[0104] In order to achieve the best shooting effect for the target speaking user, in this embodiment, the control method executes Fig. 9 Steps S940-S960.

[0105] S940, determining the real-time relative position of the head of the target speaking user in the image;

[0106] S950, obtaining a control signal of a height and a horizontal position according to the real-time relative position;

[0107] S960, output the control signal to drive the first driving device and the driving component to slide on the guide rail 90, control the height and horizontal position of the camera 80, so that the head position of the speaking user and the camera 80 are always in the same axis state for shooting.

[0108] In the above steps S940-S960, the control device obtains the real-time relative position of the corresponding head image according to the confirmed target speaking user, sends a lifting adjustment signal and a moving adjustment signal to the first driving device and the driving component, controls the height and horizontal position of the camera 80, and makes the head position of the speaking user and the camera 80 always in the same axis state for shooting.

[0109] After adjusting the shooting position of the camera 80 in the above embodiment, the control device detects whether the camera 80 exceeds the axis range of the guide rail 90. If the axis range of the guide rail 90 is detected, the shooting effect of the user who speaks will be affected. Therefore, if it exceeds the axis range of the guide rail 90, the shooting image of the user who speaks is processed by AI, and the shooting image of the user who speaks is placed in the middle of the image screen of the display screen 20.

[0110] The adjustable multimedia system provided in the present application can automatically adjust to a corresponding usage state according to the switching of usage scenarios, and can quickly adapt to different usage modes. At the same time, the control device can control the adjustment mechanism including the first lifting mechanism 30 with the help of the data collected by the information collection module, so as to provide the user with the best usage effect in each usage mode.

[0111] The control method of the adjustable multimedia system provided in the present application can, for the current usage scenario, identify the speaking user based on the acquired facial recognition information and / or corresponding sound information of each user, and obtain the real-time relative height position and horizontal position of the user's head in the image, so that the head position of the speaking user is always in the same axis state as the camera, which helps to obtain a better shooting effect for the speaking user.

[0112] Based on the same application concept as the above control method, the present application embodiment also provides a control device 100 for an adjustable multimedia system. Fig.10 , Fig.10 A schematic diagram of the structure of a control device for an adjustable multimedia system provided in one embodiment of the present application.

[0113] The confirmation module 101 is used to perform face recognition on the image captured by the camera, identify the user who is speaking in front of the display screen according to the face image, and determine the real-time relative position of the head of the speaking user in the image;

[0114] A control signal acquisition module 102, used to obtain a control signal of a height and a horizontal position according to the real-time relative position;

[0115] The shooting module 103 is used to output the control signal to drive the first driving device and the driving component to slide on the guide rail, control the height and horizontal position of the camera, and make the head position of the speaking user and the camera always be in the same axis state for shooting.

[0116] Furthermore, the confirmation module 101 may further include:

[0117] A sound analysis unit, configured to analyze the frequency of the sound information, determine multiple speaking users in front of the display screen according to the frequency of the sound information, and obtain a sound clip of each speaking user and its first timestamp;

[0118] An image acquisition unit, configured to perform face recognition on the image captured by the camera, identify the speaker in front of the display screen according to the face image, and record the real-time relative position of each speaker in the image and its corresponding second timestamp;

[0119] A matching unit is used to match the first timestamp with the second timestamp to determine a target speaking user from among the speaking users.

[0120] The control device 100 of the adjustable multimedia system provided in the embodiment of the present application can, for the current usage scenario, identify the speaking user based on the acquired facial recognition information and / or corresponding sound information of each user, and obtain the real-time relative height position and horizontal position of the user's head in the image, so that the head position of the speaking user is always in the same axis state as the camera, which helps to obtain a better shooting effect for the speaking user.

[0121] Reference Fig.11 , Fig.11 A schematic diagram of the structure of an electronic device controlled by an adjustable multimedia system provided by an embodiment of the present application.

[0122] In an optional embodiment, an electronic device 1100 is provided, such as Fig.11 As shown, Fig.11 The electronic device 1100 shown includes: a processor 1101 and a memory 1103. The processor 1101 and the memory 1103 are connected, such as through a bus 1102. Optionally, the electronic device 1100 may also include a transceiver 1104. It should be noted that in actual applications, the transceiver 1104 is not limited to one, and the structure of the electronic device 1100 does not constitute a limitation on the embodiments of the present application.

[0123] Among them, electronic devices include but are not limited to: mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig.11 The electronic device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0124] The embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer-readable storage medium is run on a computer, the computer can execute the corresponding content in the aforementioned method embodiment. Compared with the prior art, the computer-readable storage medium in the embodiment of the present application can identify the speaking user according to the acquired face recognition information and / or corresponding sound information of each user for the current usage scenario, and obtain the real-time relative height position and horizontal position of the user's head in the image, so that the head position of the speaking user is always in the same axis state as the camera, which helps to obtain a better shooting effect for the speaking user.

[0125] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0126] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0127] It should be understood that, although the steps in the flowchart of the accompanying drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least a part of the steps in the flowchart of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.

[0128] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in this application (but not limited to) by each other to form a technical solution.

Claims

1. A control method for an adjustable multimedia system, characterized in that: Applied to an adjustable multimedia system, the adjustable multimedia system comprises: a first base, a control device, a first lifting mechanism and a display screen; wherein the first lifting mechanism is equipped with a first driving device, and the display screen is provided with an information acquisition module; The display screen is installed on the first base through the first lifting mechanism; the control device is connected to the information acquisition module on the display screen and is connected to the first driving device; The control device receives the collected data of the information collection module, outputs a lifting adjustment signal to the first driving device, and adjusts the height position of the display screen; The information acquisition module includes a camera installed above the display screen, which is used to capture the image in front of the display screen and output it to the control device; A guide rail is also provided above the display screen, and the information acquisition module further includes a driving component connected to the camera, and the camera is connected to the guide rail through the driving component; The driving component is connected to the control device, and drives the camera to slide on the guide rail under the control of the control device to adjust the shooting position of the camera; The information collection module further includes a microphone, which detects external sound information and outputs the sound information to the control device; The method comprises the following steps: Performing face recognition on the image captured by the camera, identifying the user speaking in front of the display screen according to the face image, and determining the real-time relative position of the head of the speaking user in the image; Obtaining control signals of height and horizontal position according to the real-time relative position; Outputting the control signal to drive the first driving device and the driving component to slide on the guide rail, controlling the height and horizontal position of the camera, so that the head position of the speaking user and the camera are always in the same axis state for shooting; Analyze the frequency of the sound information, determine multiple speaking users in front of the display screen according to the frequency of the sound information, and obtain a sound clip of each speaking user and its first timestamp; Performing face recognition on the image captured by the camera, identifying the speaking user in front of the display screen according to the face image, and recording the real-time relative position of each speaking user in the image and its corresponding second timestamp; The first timestamp is matched with the second timestamp, and a target speaking user is determined from among the speaking users.

2. The control method of the adjustable multimedia system according to claim 1, characterized in that: Also includes: Detect whether the camera is beyond the range of the guide rail axis. If so, perform AI processing on the captured image and place the captured image of the speaking user in the center of the image screen.

3. The control method of the adjustable multimedia system according to claim 1, characterized in that: The adjustable multimedia system also includes: An audio playback device, a second base, and a second lifting mechanism; The audio player device is installed on the second base through the second lifting mechanism; the second lifting mechanism is equipped with a second driving device, which is connected to the control device and adjusts the height position of the audio player device under the control of the control device.

4. The control method of the adjustable multimedia system according to claim 1, characterized in that: The back of the display screen in the adjustable multimedia system is also provided with at least one foldable support foot, and a flip structure is provided at the connection between the first lifting mechanism and the display screen; The flip structure is connected to the control device and flips under the control of the control device. The supporting legs are opened and support the display screen, so that the display screen is placed flat or tilted on the ground.

5. The control method of the adjustable multimedia system according to claim 1, characterized in that: The first lifting mechanism in the adjustable multimedia system is connected to the display screen via a rotating structure, and the rotating structure is connected to the control device, and the rotation angle of the display screen is adjusted under the control of the control device.

Images