Self-adaptive display method, loudspeaker box and computer readable storage medium

Abstract

The invention discloses a self-adaptive display method, a loudspeaker box and a computer readable storage medium, and relates to the technical field of audio playing equipment, the self-adaptive display method is applied to the loudspeaker box, a display screen of the loudspeaker box is arranged on the top wall of the loudspeaker box, and the method comprises the following steps: detecting a touch screen operation generated on the display screen under the condition that the display screen is turned off; according to a touch screen position corresponding to the touch screen operation, determining a target display direction of a to-be-displayed target UI interface; and controlling the display screen to display the target UI interface in the target display direction. The problem of inconvenient interaction caused by the fixed display direction of the sound box in the related technology can be solved, and the equipment stability and audio experience fluency of the sound box are improved.

Description

Technical Field

[0001] This application relates to the technical field of audio playback devices, and particularly to an adaptive display method, a speaker, and a computer-readable storage medium. Background Art

[0002] In the current field of audio playback devices, in order to enhance the user experience, especially in terms of sound quality and interaction convenience, manufacturers are constantly exploring and innovating the design of speakers. One trend is that speakers adopt a cylindrical structure design, which not only helps to achieve a 360-degree all-round sound diffusion effect, thereby providing a more uniform and harmonious sound experience, but also brings unique aesthetic value to the product. In addition, such speakers usually integrate a circular touch display screen on their upper surface for users to perform various operations, such as adjusting the volume, switching songs, or adjusting audio settings, etc.

[0003] However, in actual use, due to the uncertainty of the user's position and the placement direction of the speaker, the display screen of the speaker often cannot always face the user's perspective directly, resulting in the user having to frequently manually rotate the physical position of the speaker to obtain the best viewing angle. This defect is particularly prominent when the speaker is fixedly installed or restricted by a narrow space, which not only reduces the operation convenience but also may lead to a damaged sound experience (such as the speaker vibrating or displacing during the adjustment process).

[0004] Traditional speaker designs usually fix the display screen direction to the speaker body, and users need to rely on physically rotating the speaker position or complex manual settings to adjust the display content direction, which significantly increases the usage complexity and may lead to a decrease in device stability or a fragmented user audio experience due to frequent adjustments. Summary of the Invention

[0005] The main purpose of this application is to provide an adaptive display method, a speaker, and a computer-readable storage medium, aiming to solve the problem of inconvenient interaction caused by the fixed display direction of the speaker in related technologies, so as to improve the device stability of the speaker and the smoothness of the audio experience.

[0006] To achieve the above object, this application provides an adaptive display method, which is applied to a speaker, and the display screen of the speaker is arranged on the top wall of the speaker. The method includes:

[0007] When the display screen is in the off-screen state, detect a touch operation generated on the display screen;

[0008] Determine the target display direction of the target UI (User Interface) interface to be displayed according to the touch position corresponding to the touch operation;

[0009] Control the display screen to display the target UI interface in the target display direction.

[0010] In one embodiment, the step of determining the target display direction of the target UI interface to be displayed according to the touch position corresponding to the touch operation includes:

[0011] Query from a preset first mapping relation table the display direction mapped by the touch position according to the touch position corresponding to the touch operation;

[0012] Use the mapped display direction as the target display direction of the target UI interface to be displayed.

[0013] In one embodiment, the step of determining the target display direction of the target UI interface to be displayed according to the touch position corresponding to the touch operation includes:

[0014] Determine the target pointing direction of the touch position pointing to the center position of the display screen according to the touch position corresponding to the touch operation;

[0015] Use the target pointing direction as the target display direction of the target UI interface to be displayed.

[0016] In one embodiment, the speaker further includes a camera, the camera is disposed on the side of the display screen of the speaker, and the shooting direction of the camera is consistent with the facing direction of the display screen.

[0017] After the step of controlling the display screen to display the target UI interface in the target display direction, the method further includes:

[0018] Capture a face image through the camera;

[0019] In the case where a face image is captured within a preset duration after the target UI interface is displayed, recognize face pose information based on the face image;

[0020] Correct the target display direction of the target UI interface according to the face pose information.

[0021] In one embodiment, the step of correcting the target display direction of the target UI interface according to the face pose information includes:

[0022] Query from a preset second mapping relation table the first display direction mapped by the face pose information according to the face pose information;

[0023] Correct the target display direction of the target UI interface according to the first display direction.

[0024] In one embodiment, the step of correcting the target display direction of the target UI interface according to the first display direction includes:

[0025] When the first display direction is inconsistent with the target display direction of the target UI interface, adjust the target display direction of the target UI interface to be consistent with the first display direction.

[0026] In one embodiment, the speaker further includes a human body sensor, and the human body sensor is disposed on the peripheral sidewall of the speaker.

[0027] After the step of capturing a face image by the camera, the method further includes:

[0028] When no face image is captured within a preset duration since the target UI interface is displayed, based on the human body sensor, identify the human body orientation information of the human body relative to the speaker.

[0029] According to the human body orientation information, correct the target display direction of the target UI interface.

[0030] In one embodiment, the speaker further includes a rotating track and a tooling position slidably connected to the rotating track. The rotating track surrounds the peripheral sidewall of the speaker, and the human body sensor is disposed on the tooling position. The human body sensor moves along with the movement of the tooling position on the rotating track.

[0031] The step of identifying the human body orientation information of the human body relative to the speaker based on the human body sensor includes:

[0032] Control the tooling position to move on the rotating track.

[0033] During the movement of the tooling position, sense the human body through the human body sensor.

[0034] When the human body sensor senses a human body, obtain the current moving position of the tooling position on the rotating track when the human body sensor senses the human body.

[0035] According to the current moving position, identify the human body orientation information of the human body relative to the speaker.

[0036] In one embodiment, the step of correcting the target display direction of the target UI interface according to the human body orientation information includes:

[0037] According to the human body orientation information, query the second display direction mapped by the human body orientation information from a preset third mapping relation table.

[0038] According to the second display direction, correct the target display direction of the target UI interface.

[0039] In one embodiment, the step of correcting the target display direction of the target UI interface according to the second display direction includes:

[0040] When the second display direction is inconsistent with the target display direction of the target UI interface, adjust the target display direction of the target UI interface to be consistent with the second display direction.

[0041] In addition, to achieve the above object, the present application further provides a speaker, which includes: a memory, a processor, and a computer program stored on the memory and executable on the processor. When the computer program is executed by the processor, the steps of the adaptive display method as described above are implemented.

[0042] In addition, to achieve the above object, the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the adaptive display method as described above are implemented.

[0043] In addition, to achieve the above object, the present application further provides a computer program product, which includes a computer program. When the computer program is executed by a processor, the adaptive display method as described above is implemented.

[0044] An embodiment of the present application provides an adaptive display method, a speaker, and a computer-readable storage medium. The adaptive display method is applied to a speaker, and the display screen of the speaker is disposed on the top wall of the speaker. The technical solution of the embodiment of the present application is to detect a touch operation generated on the display screen when the display screen of the speaker is in the off-screen state, and determine the target display direction of the target UI interface to be displayed according to the touch position corresponding to the touch operation, and then control the display screen to display the target UI interface in the target display direction, so as to dynamically adjust the display content direction of the UI interface on the display screen of the speaker, ensure that no matter what placement position the speaker is in, the display content can face the user directly, realize the intuitive display and convenient operation of information, without the user having to physically rotate the speaker position or perform complex manual settings to adjust the display content direction, and can automatically achieve the adaptability of the display content to match the user's viewing angle direction, effectively solve the problem of inconvenient interaction caused by the fixed display direction of the speaker in the related art, and further improve the device stability and audio experience fluency of the speaker. Description of the Drawings

[0045] The accompanying drawings herein are incorporated into and constitute a part of this specification, showing embodiments consistent with this application, and are used together with the specification to explain the principles of this application.

[0046] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the following will briefly introduce the accompanying drawings required for describing the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only some embodiments of this application. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on the structures shown in these drawings.

[0047] Figure 1 The flowchart provided for the first embodiment of the adaptive display method of this application;

[0048] Figure 2 The flowchart provided for the second embodiment of the adaptive display method of this application;

[0049] Figure 3 The flowchart provided for the third embodiment of the adaptive display method of this application;

[0050] Figure 4 The flowchart provided for the fourth embodiment of the adaptive display method of this application;

[0051] Figure 5 The schematic diagram of the speaker provided for the fourth embodiment of the adaptive display method of this application;

[0052] Figure 6 The schematic diagram of the device structure of the hardware operating environment involved in the adaptive display method in the embodiments of this application.

[0053] The implementation, functional features, and advantages of this application will be further described with reference to the embodiments and the accompanying drawings. Detailed implementation manners

[0054] Here, the exemplary embodiments will be described in detail, and the examples are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with this application. On the contrary, they are only examples of the devices and methods consistent with some aspects of this application as detailed in the appended claims.

[0055] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of this application and are not used to limit this application.

[0056] Currently, speakers designed with a cylindrical structure usually set the display screen on the top wall of the speaker and fix the content display direction of the display screen to the speaker body.

[0057] Due to the uncertainty of the user's position and the orientation of the speaker, it is difficult to ensure that the display content on the display screen is directly facing the user's perspective in practical applications, resulting in inconvenient operation. Often, the user needs to manually adjust the position and orientation of the speaker to obtain the best viewing angle for operation. At the same time, frequent manual adjustment is likely to lead to a decline in device stability or a fragmented user audio experience, and the overall user experience is poor.

[0058] To this end, the main solution of the embodiment of the present application is an adaptive display method. The adaptive display method is applied to a speaker, and the display screen of the speaker is provided on the top wall of the speaker. The method includes: when the display screen is in the off-screen state, detecting a touch operation generated on the display screen; determining a target display direction of a target UI interface to be displayed according to a touch position corresponding to the touch operation; and controlling the display screen to display the target UI interface in the target display direction.

[0059] The embodiment of the present application can detect a touch operation when the display screen is in the off-screen state, and determine the best display direction of the target UI interface to be displayed according to the touch position, so as to control the display screen to display the target UI interface in the best display direction. In this way, no matter what position the speaker is placed in, as long as the user touches the display screen on the side close to the user to turn on the display screen, the content on the display screen can be automatically adjusted to be directly facing the user's perspective without the user having to perform physical rotation or complex manual settings. The embodiment of the present application not only improves the operation convenience of the user, but also avoids device vibration or displacement caused by frequent adjustment, ensuring the smoothness of the audio experience. Through this intelligent design improvement, the user can interact with the speaker more intuitively and naturally, effectively improving the overall user experience of the speaker.

[0060] It should be noted that the execution subject of the embodiment of the present application is a speaker. Hereinafter, taking the speaker as the execution subject as an example, the following embodiments of the present application will be described.

[0061] To better understand the technical solution of the present application, the following will be described in detail in conjunction with the accompanying drawings of the specification and specific embodiments.

[0062] The present application proposes an adaptive display method for the first embodiment.

[0063] Please refer to Figure 1 , Figure 1 which is a schematic flowchart provided for the first embodiment of the adaptive display method of the present application.

[0064] In this embodiment, the adaptive display method is applied to a speaker, and the display screen of the speaker is provided on the top wall of the speaker. The method includes steps S100 to S300:

[0065] Step S100: When the display screen is in the screen-off state, detect the touch screen operation generated on the display screen;

[0066] In this embodiment, in the screen-off state, the display screen on the top wall of the speaker can still sense and respond to the touch screen operation of the user. Therefore, when the user needs to control the speaker through the display screen on the top wall of the speaker, the display screen can be lit by touch screen operations such as clicking and swiping.

[0067] Step S200: Determine the target display direction of the target UI interface to be displayed according to the touch screen position corresponding to the touch screen operation;

[0068] It should be noted that the touch screen position refers to the position where the touch screen operation acts on the display screen. The target UI (User Interface) interface refers to the user interface that needs to be displayed on the display screen when the display screen is lit. The target display direction refers to the display direction when the target UI interface is displayed on the display screen.

[0069] In this embodiment, when the display screen is in the screen-off state, if a touch screen operation of the user on the display screen is detected, it can be determined that the user hopes to light the display screen and control the speaker through the target UI interface.

[0070] To ensure that the target UI interface is facing the user's perspective when the display screen is lit, in this embodiment, after detecting the touch screen operation input when the screen is off, first determine the touch screen position corresponding to the touch screen operation, and then determine the best display direction of the target UI interface according to the touch screen position as the target display direction, so as to control the display screen to display the target UI interface in the target display direction in the subsequent steps.

[0071] In this embodiment, the user only needs to light the display screen through a touch screen operation on the display screen on the side close to the user, and it can be ensured that the target UI interface displayed after the display screen is lit is facing the user's perspective, without the need to manually rotate the speaker or enter complex menu settings to adjust the display direction. The overall process is relatively simple, the operation portability is high, and the user experience is better.

[0072] In a feasible implementation manner, step S200 may include steps S210 to S220:

[0073] Step S210: Query the display direction mapped by the touch screen position from the preset first mapping relation table according to the touch screen position corresponding to the touch screen operation;

[0074] It should be noted that the first mapping relation table is a preset mapping relation table, on which the mapping relations between different touch screen positions and display directions are recorded.

[0075] In this embodiment, the touch screen position corresponding to the touch screen operation is matched with a preset first mapping table, so as to quickly query the display direction mapped by the touch screen position, reduce the time required for real-time calculation, and improve the response speed.

[0076] Step S220: Use the mapped display direction as the target display direction of the target UI interface to be displayed.

[0077] In this embodiment, after querying the display direction mapped by the touch screen position through the first mapping table, the display direction mapped by the touch screen position is directly used as the target display direction, ensuring that the display direction of the target UI interface is consistent with the display direction mapped by the touch screen position. This enables the user to simply light up the display screen through a touch screen operation on the display screen close to the user, and the target UI interface displayed after the display screen is lit will be directly facing the user's perspective, without the need to manually rotate the speaker or enter complex menu settings to adjust the display direction. This simplifies the user's operation process, reduces unnecessary adjustment steps, improves the usability and user satisfaction of the speaker, and at the same time reduces the risk of device vibration or displacement caused by physical movement, enhances the stability of the speaker, and ensures the coherence and consistency of the sound effect experience. Furthermore, it effectively solves the problem of inconvenient interaction caused by the fixed display direction of the speaker in the related art and improves the overall user experience when using the speaker.

[0078] In another feasible embodiment, step S200 may further include steps S230 to S240:

[0079] Step S230: Determine the target pointing direction of the touch screen position pointing to the center position of the display screen according to the touch screen position corresponding to the touch screen operation;

[0080] It should be noted that the center position of the screen refers to the center position of the display screen. Exemplarily, when the display screen is circular, the center position of the screen refers to the center of the display screen.

[0081] It should also be noted that the target pointing direction refers to the direction of the touch screen position pointing to the center position of the screen.

[0082] Step S240: Use the target pointing direction as the target display direction of the target UI interface to be displayed.

[0083] In this embodiment, according to the touch screen position corresponding to the touch screen operation, the target pointing direction from the touch screen position to the center position of the screen is dynamically calculated, and used as the target display direction of the target UI interface when the display screen is lit. This enables, no matter from which angle the user wishes to use the speaker, as long as the display screen on the side close to the user is lit through touch screen operation, the best display direction can be accurately calculated through simple geometric calculations, ensuring that the displayed content can be aligned with the user's perspective, without the need to maintain a complex mapping relationship table, effectively reducing the system complexity and maintenance cost, and reducing the system's resource occupancy and development difficulty.

[0084] Step S300: Control the display screen to display the target UI interface in the target display direction.

[0085] In this embodiment, after determining the target display direction of the target UI interface, the display screen is automatically controlled to display the target UI interface in the target display direction, without the user physically rotating the speaker or manually setting the display direction, which can ensure that the displayed content is directly facing the user's perspective, facilitating the user to view and operate the displayed content on the display screen.

[0086] This embodiment can detect touch screen operations when the display screen is in the off-screen state, determine the best display direction of the target UI interface to be displayed according to the touch screen position, and thus control the display screen to display the target UI interface in this best display direction. In this way, no matter what the placement position of the speaker is, as long as the user lights the display screen through touch screen operation on the display screen on the side close to the user, the content on the display screen can be automatically adjusted to be directly facing the user's perspective, without the user having to perform physical rotation or complex manual settings. This embodiment not only improves the user's operation convenience, but also avoids device vibration or displacement caused by frequent adjustment, ensuring the smoothness of the sound effect experience. Through this intelligent design improvement, users can interact with the speaker more intuitively and naturally, effectively enhancing the overall user experience of the speaker.

[0087] Based on the above first embodiment, the second embodiment of the adaptive display method of the present application is proposed.

[0088] In the second embodiment of the present application, for the content that is the same as or similar to the above embodiment, reference can be made to the above introduction and will not be elaborated hereinafter.

[0089] Please refer to Figure 2 , Figure 2 which is the flow diagram provided for the second embodiment of the adaptive display method of the present application.

[0090] In this embodiment, the speaker further includes a camera, the camera is provided on the side of the display screen of the speaker, and the shooting direction of the camera is the same as the orientation direction of the display screen. After step S300, the adaptive display method may further include steps S400 - S600:

[0091] Step S400: Capture a face image through a camera;

[0092] It should be noted that a face image refers to a photo or video frame of a user's face captured by a camera.

[0093] In this embodiment, the speaker not only includes a display screen on the top wall but also is equipped with a camera. The camera is provided on the side of the display screen of the speaker, and the shooting direction is the same as the orientation direction of the display screen. Thus, in the process of using the speaker in this embodiment, the camera can capture the user's face image in real time, periodically, or within a specific time, identify the face pose information of the face relative to the speaker when the user operates the speaker, and then correct the target display direction of the target UI interface to ensure that the display content on the display screen is always facing the user's perspective.

[0094] Step S500: When a face image is captured within a preset duration after the target UI interface is displayed, obtain the face pose information based on the recognition of the face image;

[0095] It should be noted that the preset duration is a pre-set time length. After the display screen is lit and the target UI interface is displayed, if the camera captures a face image within the preset duration, the target display direction of the target UI interface can be corrected based on the face image to ensure that the display content on the display screen faces the user's perspective.

[0096] In this embodiment, within the preset duration after the display screen is lit and the target UI interface is displayed, the camera captures the face image. On the one hand, it can provide a reasonable reaction time window for the user to ensure that the user can place the face within the effective capture range of the camera within this time period. On the other hand, it can limit the activation time of the camera, avoiding the camera being always in the startup state and continuously capturing face images, which not only wastes resources but also causes the target UI interface to be adjusted frequently, seriously affecting the user experience.

[0097] It should also be noted that the face pose information refers to the angle and position information of the user's head in the face image relative to the camera. Exemplarily, the face pose information may include the spatial position of the user's head in the face image relative to the camera, the Euler angle of the user's head in the face image relative to the camera, the direction in which the midpoint of the line connecting the user's two eyes points to the center of the image in the face image, etc.

[0098] In this embodiment, when a face image is captured by the camera within a preset time period after the target UI interface is displayed on the display screen, the face pose information can also be extracted from the face image through computer vision algorithms to assist the system in precisely adjusting the target display direction of the target UI interface, ensuring that even if the target display direction determined based on the touch screen position is inconsistent with the user's perspective, the display content on the display screen can be directly facing the user's perspective after correction, thereby enhancing the intuitiveness and naturalness of the user experience, strengthening the robustness and adaptability of the system, and providing a fault tolerance mechanism.

[0099] Step S600: Correct the target display direction of the target UI interface according to the face pose information.

[0100] Based on the face pose information obtained in step S500, this embodiment corrects the target display direction of the target UI interface to ensure that even if the target display direction determined based on the touch screen position does not match the user's perspective, the display content on the display screen can be directly facing the user's perspective after correction, thereby enhancing the user's interaction experience and making the operation of the display screen on the top wall of the speaker more convenient and natural.

[0101] By introducing a method of using the camera to capture face images and identify face pose information, this embodiment realizes a higher-precision display direction adjustment and directly applies the correction result to the content adjustment of the display screen, not only improving the accuracy of adaptive display, but also enhancing the robustness and adaptability of the system, and further improving the operation convenience of the speaker and the overall user experience.

[0102] In a feasible implementation manner, step S600 may include steps S610 to S620:

[0103] Step S610: Query the first display direction mapped by the face pose information from a preset second mapping relation table according to the face pose information.

[0104] It should be noted that the second mapping relation table is a preset mapping relation table, which records the mapping relations between different face pose information and display directions. The first display direction refers to the display direction mapped by the face pose information in the second mapping relation table.

[0105] In this implementation manner, the face pose information corresponding to the face image captured by the camera within a preset time period after the target UI interface is displayed on the display screen is matched with the preset second mapping relation table, so as to quickly query the first display direction mapped by the face pose information, reduce the time required for real-time calculation, and improve the response speed.

[0106] Step S620: Correct the target display direction of the target UI interface according to the first display direction.

[0107] After querying the first display direction mapped by the face pose information through the second mapping relationship table in this embodiment, the target display direction of the target UI interface is corrected according to the first display direction, ensuring that even if the target display direction determined based on the touch screen position does not match the user's perspective, it can be corrected by the first display direction mapped by the face pose information, providing an additional fault tolerance mechanism to achieve multi-level adaptive display, so as to ensure that the display direction of the target UI interface is consistent with the user's perspective, improve the accuracy of adaptive display, and further enhance the operation convenience of the speaker and the overall user experience.

[0108] Further, in a feasible embodiment, step S620 may include step S621:

[0109] Step S621: When the first display direction is inconsistent with the target display direction of the target UI interface, adjust the target display direction of the target UI interface to be consistent with the first display direction.

[0110] In this embodiment, after determining the first display direction mapped by the face pose information, first determine whether the first display direction is consistent with the current target display direction of the target UI interface. If they are consistent, no correction is required. Otherwise, adjust the target display direction of the target UI interface to be consistent with the first display direction, so as to ensure that the display content on the display screen faces the user's perspective directly.

[0111] Compared with the direct correction method, this embodiment only performs correction when it is detected that the first display direction is inconsistent with the current display direction of the target UI interface, which can effectively reduce invalid correction operations, thus avoiding meaningless resource waste and improving resource utilization.

[0112] It is worth mentioning that in this embodiment, in addition to the embodiment of querying the first display direction mapped by the face pose information through the second mapping relationship table and then correcting the target display direction based on the first display direction, it is also possible to estimate the deviation angle (also called the display direction deviation angle) between the current target display direction of the target display interface and the user's perspective according to the face pose information, and then correct the target display direction according to the display direction deviation angle.

[0113] Exemplarily, step S600 may further include: determining the display direction deviation angle of the target UI interface according to the face pose information; correcting the target display direction of the target UI interface according to the display direction deviation angle.

[0114] Based on the above second embodiment, the adaptive display method of the third embodiment of the present application is proposed.

[0115] In the third embodiment of the present application, for the same or similar content as in the above embodiments, reference may be made to the above introduction and will not be repeated hereinafter.

[0116] Please refer to Figure 3 , Figure 3 which is a schematic flowchart provided for the third embodiment of the adaptive display method of the present application.

[0117] In this embodiment, the speaker further includes a human body induction sensor, which is disposed on the peripheral sidewall of the speaker. After step S400, the adaptive display method may further include steps S700 to S800:

[0118] Step S700, in the case that no human face image is captured within a preset duration since the target UI interface is displayed, based on the human body induction sensor, the human body orientation information of the human body relative to the speaker is recognized;

[0119] It should be noted that the human body induction sensor is a sensor installed on the peripheral sidewall of the speaker, which is used to detect and recognize the presence of a human body and its orientation information relative to the speaker. Exemplarily, the human body induction sensor can be implemented by an infrared sensor or a pyroelectric sensor.

[0120] It should also be noted that the human body orientation information refers to the orientation information of the human body relative to the speaker. Exemplarily, the human body orientation information may include the angle, angle range, etc. of the human body relative to the speaker.

[0121] In this embodiment, in the case that the camera fails to capture a human face image within a preset duration since the target UI interface is displayed on the display screen, the human body orientation information of the user relative to the speaker can also be recognized through the human body induction sensor, assisting the system to accurately adjust the target display direction of the target UI interface, ensuring that even if the correction based on the human face pose information cannot be implemented, the display content on the display screen can be directly facing the user's perspective through an additional fault tolerance mechanism, thereby improving the intuitiveness and naturalness of the user experience, enhancing the robustness and adaptability of the system, and providing a stronger fault tolerance mechanism.

[0122] In this embodiment, a plurality of human body induction sensors can be arranged at intervals around the peripheral sidewall of the speaker, so as to recognize the human body orientation information of the human body relative to the speaker according to the data collected by each human body induction sensor and the positions of each human body induction sensor. Alternatively, a rotating track can be arranged around the peripheral sidewall of the speaker, and then the human body induction sensor is arranged on the rotating track, and the human body induction sensor is controlled to move around the peripheral sidewall of the speaker along the rotating track, so as to recognize the human body orientation information of the human body relative to the speaker according to the data collected by the human body induction sensor at different positions during the movement.

[0123] Step S800: Correct the target display direction of the target UI interface according to the human body orientation information.

[0124] Based on the human body orientation information obtained in step S700, this embodiment corrects the target display direction of the target UI interface to ensure that even if the correction based on the face pose information cannot be implemented, an additional fault tolerance mechanism can ensure that the display content on the display screen is directly facing the user's perspective, thereby enhancing the user's interaction experience and making the operation of the display screen on the top wall of the speaker more convenient and natural.

[0125] In this embodiment, by introducing a method of using a human body sensor to identify the human body orientation information of the human body relative to the speaker when the user operates the speaker, in the case where the camera cannot capture the face image within the preset time, resulting in the inability to implement the correction based on the face pose information, an additional fault tolerance mechanism is provided to ensure that the display content on the display screen is directly facing the user's perspective and further improve the accuracy of adaptive display.

[0126] In this embodiment, the speaker is also equipped with a human body sensor, and the human body sensor is provided on the peripheral side wall of the speaker. In this setting, even if the camera does not capture the face image within the preset time period when the target UI interface is displayed on the display screen, this embodiment can still capture the human body in real time, periodically, or at a specific time through the human body sensor, identify the human body orientation information of the human body relative to the speaker when the user operates the speaker, and then correct the target display direction of the target UI interface based on the human body orientation information in the case where the correction based on the face pose information cannot be implemented, ensuring that the display content on the display screen is always directly facing the user's perspective and achieving a higher fault tolerance rate.

[0127] In a feasible implementation manner, step S800 may further include steps S810 to S820:

[0128] Step S810: Query the second display direction mapped by the human body orientation information from the preset third mapping relationship table according to the human body orientation information.

[0129] It should be noted that the third mapping relationship table is a pre-set mapping relationship table, which records the mapping relationship between different human body orientation information and display directions. The second display direction refers to the display direction mapped by the human body orientation information in the third mapping relationship table.

[0130] In this implementation manner, the human body orientation information of the human body relative to the speaker identified by the human body sensor is matched with the preset third mapping relationship table, so as to quickly query the second display direction mapped by the human body orientation information, reduce the time required for real-time calculation, and improve the response speed.

[0131] Step S820: Correct the target display direction of the target UI interface according to the second display direction.

[0132] In this embodiment, after querying the second display direction mapped by the human body orientation information through the third mapping relation table, the target display direction of the target UI interface is corrected according to the second display direction, ensuring that even if the camera does not capture a face image within the preset duration when the target UI interface is displayed on the display screen, the correction can still be performed through the second display direction mapped by the human body orientation information, providing an additional fault tolerance mechanism to achieve multi-level adaptive display, so as to ensure that the display direction of the target UI interface is consistent with the user's perspective, improve the accuracy of adaptive display, and further enhance the operation convenience of the speaker and the overall user experience.

[0133] Further, in a feasible embodiment, step S820 may include step S821:

[0134] Step S821: When the second display direction is inconsistent with the target display direction of the target UI interface, adjust the target display direction of the target UI interface to be consistent with the second display direction.

[0135] In this embodiment, after determining the second display direction mapped by the human body orientation information, first determine whether the second display direction is consistent with the current target display direction of the target UI interface. If they are consistent, no correction is required. Otherwise, adjust the target display direction of the target UI interface to be consistent with the second display direction, so as to ensure that the display content on the display screen faces the user's perspective directly.

[0136] Compared with the direct correction method, this embodiment only performs correction when it is detected that the second display direction is inconsistent with the current display direction of the target UI interface, which can effectively reduce invalid correction operations, avoid meaningless resource waste, and improve resource utilization.

[0137] It is worth mentioning that in this embodiment, in addition to the embodiment of querying the second display direction mapped by the human body orientation information through the third mapping relation table and then correcting the target display direction based on the second display direction, the deviation angle (also called the display direction deviation angle) between the current target display direction of the target display interface and the user's perspective can also be estimated according to the human body orientation information, and then the target display direction is corrected according to the display direction deviation angle.

[0138] Exemplarily, step S800 may further include: determining the display direction deviation angle of the target UI interface according to the human body orientation information; correcting the target display direction of the target UI interface according to the display direction deviation angle.

[0139] In addition, in this embodiment, after directly controlling the display screen to display the target UI interface in the target display direction in step S300, the target display direction can be corrected by the human body induction sensor, or after correcting the target display direction of the target UI interface according to the face pose information in step S600, the target display direction can be corrected again by the human body induction sensor. Those skilled in the art can derive the specific implementation steps of the above two solutions based on the above content of this embodiment, and this embodiment will not elaborate here.

[0140] Based on the above third embodiment, an adaptive display method according to the fourth embodiment of the present application is proposed.

[0141] In the fourth embodiment of the present application, the same or similar content as the above embodiments can be referred to the above introduction, and will not be elaborated hereinafter.

[0142] Please refer to Figure 4 , Figure 4 which is a schematic flowchart provided for the fourth embodiment of the adaptive display method of the present application.

[0143] In this embodiment, the speaker further includes a rotating track and a tooling position slidably connected to the rotating track. The rotating track surrounds the peripheral side wall of the speaker, and the human body induction sensor is arranged on the tooling position. The human body induction sensor moves along with the movement of the tooling position on the rotating track. The step of identifying the human body orientation information of the human body relative to the speaker based on the human body induction sensor in step S700 may include steps S710 to S740:

[0144] Step S710, controlling the tooling position to move on the rotating track;

[0145] It should be noted that the rotating track is a track provided around the peripheral side wall of the speaker, which is used to support and guide the human body induction sensor to move around the peripheral side wall of the speaker. The tooling position is a device slidably connected to the rotating track, which is used to fix and carry the human body induction sensor and realize the movement of the human body induction sensor around the peripheral side wall of the speaker.

[0146] As Figure 5 shown, in an example, a rotating track is provided on the peripheral side wall of the speaker, a display screen is provided on the top wall, a tooling position slidably connected to the rotating track is provided on the rotating track, and a human body induction sensor is provided on the tooling position, which can move along with the movement of the tooling position on the rotating track.

[0147] Step S720, during the movement of the tooling position, sensing the human body through the human body induction sensor;

[0148] Step S730, when the human body induction sensor senses a human body, obtain the current moving position of the tooling position on the rotating track when the human body induction sensor senses the human body;

[0149] It should be noted that the current moving position refers to the position of the tooling position on the rotating track at the current moment.

[0150] In this embodiment, a certain position on the rotating track can be predefined as a reference position, and then the different positions on the rotating track can be represented by the distance, angle or radian of moving along the rotating track in the clockwise or counterclockwise direction starting from this reference position.

[0151] Step S740, according to the current moving position, identify the human body orientation information of the human body relative to the speaker.

[0152] In this embodiment, when the tooling position moves along the rotating track, it will drive the human body induction sensor thereon to move around the circumferential side wall of the speaker together, so that the human body induction sensor can sense the presence of the human body during the process of moving around the circumferential side wall of the speaker, and thus, according to the moving position of the tooling position on the rotating track when the human body is sensed, the human body orientation information of the human body relative to the speaker can be identified.

[0153] Compared with the embodiment of setting multiple human body induction sensors on the circumferential side wall, this embodiment only needs to set one human body induction sensor to identify the human body orientation information, with lower cost, and the way of surrounding and sensing along the rotating track can identify more accurate human body orientation information.

[0154] It should be particularly noted that in this embodiment, the current moving position can refer only to the moving position of the tooling position on the rotating track when the human body is first sensed during the process of the human body induction sensor surrounding and sensing along the rotating track. It can also include the target moving interval of the tooling position on the rotating track during the period when the human body can be sensed during the process of the human body induction sensor surrounding and sensing along the rotating track.

[0155] It can be understood that if the current moving position refers only to the moving position of the tooling position on the rotating track when the human body is first sensed, then directly determine the orientation information of the human body relative to the speaker according to the moving position at this time. At the same time, when the human body is sensed, stop controlling the movement of the tooling position to reduce energy consumption. And if the current moving position includes the target moving interval of the tooling position on the rotating track during each period when the human body is sensed, then comprehensively determine the orientation information of the human body relative to the speaker according to the target moving interval of the tooling position on the rotating track to improve the recognition accuracy of the human body orientation information.

[0156] In addition, please refer to Figure 6 , Figure 6The device structure diagram of the hardware operating environment involved in the adaptive display method in the embodiments of the present application.

[0157] The present application also provides a speaker, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the steps of the adaptive display method in the above embodiments.

[0158] Reference is made below to Figure 6 , which shows a schematic structural diagram of a speaker suitable for implementing the embodiments of the present application. Figure 6 The speaker shown is merely an example and should not impose any limitation on the functions and scope of use of the embodiments of the present application.

[0159] As Figure 6 shown, the speaker may include a processing device 1001 (such as a central processing unit, a graphics processing unit, etc.), which may perform various appropriate actions and processes according to a program stored in a read-only memory 1002 or a program loaded from a storage device 1003 into a random access memory 1004. In the random access memory 1004, various programs and data required for the operation of the speaker are also stored. The processing device 1001, the read-only memory 1002, and the random access memory 1004 are connected to each other through a bus 1005. An input / output interface 1006 is also connected to the bus. Generally, the following systems may be connected to the input / output interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 may allow the speaker to communicate with other devices wirelessly or wiredly to exchange data. Although the figure shows a speaker with various systems, it should be understood that it is not required to implement or have all the systems shown. Instead, more or fewer systems may be implemented or had.

[0160] In particular, according to the embodiments disclosed in the present application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium. The computer program contains program codes for executing the methods shown in the flowcharts. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a read-only memory 1002. When the computer program is executed by a processing device 1001, the above functions defined in the methods of the embodiments disclosed in the present application are executed.

[0161] The speaker provided by the present application adopts the adaptive display method in the above embodiments, which can solve the problem of inconvenient interaction caused by the fixed display direction of the speaker in the related art, so as to improve the device stability and audio experience fluency of the speaker. Compared with the prior art, the beneficial effects of the speaker provided by the present application are the same as those of the adaptive display method provided by the above embodiments, and other technical features in the speaker are the same as those disclosed in the above embodiment methods, which will not be elaborated here.

[0162] It should be understood that each part disclosed in the present application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in a suitable manner in any one or more embodiments or examples.

[0163] The above is only the specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present application, and all of them should be covered by the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the above-mentioned claims.

[0164] In addition, the present application also provides a computer-readable storage medium, which has computer-readable program instructions (i.e., computer programs) stored thereon. The computer-readable program instructions are used to execute the steps of the adaptive display method in the above embodiments.

[0165] The computer-readable storage medium provided by this application can be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or components, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memories, read-only memories, erasable programmable read-only memories, optical fibers, portable compact disk read-only memories, optical storage devices, magnetic storage devices, or any suitable combination of the above. In this embodiment, the computer-readable storage medium can be any tangible medium that contains or stores a program, which can be used by or in conjunction with an instruction execution system, device, or component. The program code contained on the computer-readable storage medium can be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0166] The above computer-readable storage medium can be included in the speaker; or it can exist separately and not be assembled into the speaker.

[0167] The above computer-readable storage medium carries one or more programs. When the above one or more programs are executed by the speaker, the speaker is caused to: detect a touch screen operation generated on the display screen when the display screen is in the off-screen state; determine the target display direction of the target UI interface to be displayed according to the touch position corresponding to the touch screen operation; and control the display screen to display the target UI interface in the target display direction.

[0168] Computer program code for performing the operations of this application can be written in one or more programming languages or combinations thereof. The above programming languages include object-oriented programming languages - such as Java, Smalltalk, C++, and also include conventional procedural programming languages - such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, executed as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network - including a local area network (LAN) or a wide area network (WAN) - or can be connected to an external computer (for example, by using an Internet service provider to connect through the Internet).

[0169] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present application. In this regard, each box in the flowchart or block diagram may represent a module, a segment of a program, or a portion of code that contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the boxes may occur in a different order than that marked in the accompanying drawings. For example, two consecutive boxes shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, as well as combinations of boxes in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0170] The modules described in the embodiments of the present application can be implemented in software or in hardware. In some cases, the name of the module does not constitute a limitation on the unit itself.

[0171] The computer-readable storage medium provided by the present application stores computer-readable program instructions (i.e., computer programs) for performing the steps of the above-mentioned adaptive display method, which can solve the problem of inconvenient interaction caused by the fixed display direction of the speaker in the related art, so as to improve the device stability of the speaker and the smoothness of the audio experience. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the present application are the same as those of the adaptive display method provided by the above embodiments, and will not be elaborated here.

[0172] In addition, the embodiments of the present application also provide a computer program product, including a computer program, which when executed by a processor implements the steps of the adaptive display method in the above embodiments.

[0173] The computer program product provided by the present application can solve the problem of inconvenient interaction caused by the fixed display direction of the speaker in the related art, so as to improve the device stability of the speaker and the smoothness of the audio experience. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiments of the present application are the same as those of the adaptive display method provided by the above embodiments, and will not be elaborated here.

[0174] The above are only some embodiments of the present application, and thus do not limit the patent scope of the present application. Any equivalent structural transformation made under the technical concept of the present application by using the content of the specification and drawings of the present application, or any direct / indirect application in other related technical fields, is included in the patent protection scope of the present application.

Claims

1. An adaptive display method, characterized in that, The adaptive display method is applied to a speaker, and a display screen of the speaker is arranged on the top wall of the speaker. The method includes: When the display screen is in the off-screen state, detecting a touch operation generated on the display screen; Determining a target display direction of a target UI interface to be displayed according to a touch position corresponding to the touch operation; Controlling the display screen to display the target UI interface in the target display direction.

2. The adaptive display method according to claim 1, wherein The step of determining the target display direction of the target UI interface to be displayed according to the touch position corresponding to the touch operation includes: Querying, from a preset first mapping relation table, a display direction mapped by the touch position according to the touch position corresponding to the touch operation; Taking the mapped display direction as the target display direction of the target UI interface to be displayed.

3. The adaptive display method according to claim 1, wherein The step of determining the target display direction of the target UI interface to be displayed according to the touch position corresponding to the touch operation includes: Determining a target pointing direction in which the touch position points to the center position of the display screen of the display screen according to the touch position corresponding to the touch operation; Taking the target pointing direction as the target display direction of the target UI interface to be displayed.

4. The adaptive display method according to any one of claims 1 to 3, characterized in that The speaker further includes a camera, the camera is arranged on the side of the display screen of the speaker, and a shooting direction of the camera is consistent with a facing direction of the display screen. After the step of controlling the display screen to display the target UI interface in the target display direction, the method further includes: Capturing a face image through the camera; When a face image is captured within a preset duration after the target UI interface is displayed, obtaining face pose information by recognizing the face image; Correcting the target display direction of the target UI interface according to the face pose information.

5. The adaptive display method according to claim 4, wherein The step of correcting the target display direction of the target UI interface according to the face pose information includes: Querying, from a preset second mapping relation table, a first display direction mapped by the face pose information according to the face pose information; Correcting the target display direction of the target UI interface according to the first display direction.

6. The adaptive display method according to claim 5, characterized in that, The step of correcting the target display direction of the target UI interface according to the first display direction includes: When the first display direction is inconsistent with the target display direction of the target UI interface, adjusting the target display direction of the target UI interface to be consistent with the first display direction.

7. The adaptive display method according to claim 4, wherein The speaker further includes a human body induction sensor, and the human body induction sensor is arranged on the peripheral side wall of the speaker. After the step of capturing a face image through the camera, the method further includes: When a face image is not captured within a preset duration after the target UI interface is displayed, obtaining human body orientation information of the human body relative to the speaker based on the human body induction sensor; Correcting the target display direction of the target UI interface according to the human body orientation information.

8. The adaptive display method according to claim 7, wherein The speaker further includes a rotating track and a tooling position slidably connected to the rotating track. The rotating track surrounds the peripheral side wall of the speaker, and the human body induction sensor is arranged on the tooling position. The human body induction sensor moves along with the movement of the tooling position on the rotating track. The step of identifying the human body orientation information of the human body relative to the speaker based on the human body induction sensor includes: Controlling the tooling position to move on the rotating track; During the movement of the tooling position, the human body is sensed by the human body induction sensor; When the human body induction sensor senses the human body, obtain the current moving position of the tooling position on the rotating track when the human body induction sensor senses the human body; Based on the current moving position, identify the human body orientation information of the human body relative to the speaker.

9. The adaptive display method according to claim 7, wherein The step of correcting the target display direction of the target UI interface according to the human body orientation information includes: According to the human body orientation information, query the second display direction mapped by the human body orientation information from a preset third mapping relation table; According to the second display direction, correct the target display direction of the target UI interface.

10. The adaptive display method according to claim 9, wherein, The step of correcting the target display direction of the target UI interface according to the second display direction includes: When the second display direction is inconsistent with the target display direction of the target UI interface, adjust the target display direction of the target UI interface to be consistent with the second display direction.

11. A speaker, characterized in that, including: A memory, a processor, and a computer program stored on the memory and executable on the processor. When the computer program is executed by the processor, it implements the adaptive display method according to any one of claims 1 to 10.

12. A computer-readable storage medium, characterized in that, A computer program is stored on the computer-readable storage medium. When the computer program is executed by the processor, it implements the adaptive display method according to any one of claims 1 to 10.

Images