Screen angle adjusting method and device, electronic equipment and computer readable storage medium
By acquiring and analyzing the user's voice and image data, determining multiple optimal screen angles, and folding the TV screen into multiple sub-screens, precise angle adjustments are achieved in multiple audience scenarios, solving the problem that cannot meet personalized needs in the prior art and improving the user experience.
Patent Information
- Application Number
- CN202411848605.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-13
- Publication Date
- 2025-03-28
- Estimated Expiration
- 2044-12-13
AI Technical Summary
The prior art is difficult to achieve precise angle adjustment of TV screens, especially under the personalized needs of multiple viewers, which cannot be automatically adjusted to the optimal screen angle.
By obtaining the orientation of the adjustment command for the screen angle, multiple optimal screen angles are determined, and the screen is folded into multiple sub-screens, adjusting its angles separately to match the optimal viewing position of each user.
It is realized that when users in multiple different directions issue screen angle adjustment commands, the angle of each sub-screen can be accurately adjusted to meet the personalized needs of each user and improve the user's viewing experience.
Smart Images

Figure CN119729068A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the technical field of screen adjustment, and specifically to a screen angle adjustment method, device, electronic device, and computer-readable storage medium. Background Art
[0002] The related art mainly realizes the angle adjustment of the TV screen by manually rotating the entire TV. Or several angles are preset and the TV screen is rotated to the preset angles through a remote control. However, manual adjustment is troublesome and it is difficult to accurately adjust to the best viewing angle required by the user. The remote control can only be adjusted to several preset fixed angles, which cannot meet the personalized needs of users at different viewing positions. Summary of the invention
[0003] The embodiments of the present application provide a screen angle adjustment method, device, electronic device and computer-readable storage medium, which can meet the needs of multiple viewers and automatically adjust the screen to an optimal screen angle.
[0004] In a first aspect, an embodiment of the present application provides a screen angle adjustment method, comprising:
[0005] Get the position of the screen angle adjustment command;
[0006] When there are multiple adjustment commands in different directions, determining multiple optimal screen angles according to the multiple directions; and
[0007] The screen is folded into a plurality of sub-screens, and the angles of the plurality of sub-screens are respectively adjusted to the plurality of optimal screen angles.
[0008] In one embodiment, obtaining the position of the screen angle adjustment command includes:
[0009] Collecting user voice, and analyzing the user voice to determine whether the user voice is an adjustment command voice;
[0010] When the user voice is the adjustment command voice, obtaining the direction of the adjustment command voice;
[0011] Acquire a user image of the position of the adjustment command voice;
[0012] Performing image recognition on the user image to obtain the position of the target user who issued the adjustment command voice;
[0013] The direction of the adjustment command is determined according to the direction of the adjustment command voice and the direction of the target user.
[0014] In one embodiment, collecting user voice includes:
[0015] Based on multiple audio collection devices, collect the user voice;
[0016] The obtaining the position of the adjustment command voice includes:
[0017] Obtaining the time when the adjustment command voice arrives at each of the audio acquisition devices;
[0018] Determine the arrival time difference according to the time when the adjustment command voice arrives at each of the audio collection devices;
[0019] Based on the arrival time difference, the direction of the adjustment command voice is determined.
[0020] In one embodiment, the user image includes a plurality of images; and performing image recognition on the user image to obtain the position of the target user who issues the adjustment command voice includes:
[0021] Determining a target user who issues the adjustment command voice according to the opening and closing conditions of the mouths of each user in the plurality of user images;
[0022] The user image is analyzed to obtain the location of the target user.
[0023] In one of the embodiments, after adjusting the angles of the plurality of sub-screens to the plurality of optimal screen angles respectively, the method further comprises:
[0024] Continuously collecting user sub-images of each user corresponding to each of the sub-screens;
[0025] Determining a target angle according to facial information in each of the user sub-images;
[0026] The angle of each of the sub-screens is adjusted to the target angle in real time.
[0027] In one embodiment, the method further comprises:
[0028] Play the same content in the multiple sub-screens; or
[0029] Different contents are played in the plurality of sub-screens.
[0030] In one embodiment, determining a plurality of optimal screen angles according to the plurality of orientations comprises:
[0031] The angle directly opposite to the orientation of each adjustment command is determined as the optimal screen angle.
[0032] In a second aspect, an embodiment of the present application provides a screen angle adjustment device, comprising:
[0033] An acquisition module, used for acquiring the position of the screen angle adjustment command;
[0034] A determination module, configured to determine a plurality of optimal screen angles according to the plurality of orientations when there are a plurality of adjustment commands in different orientations;
[0035] The adjustment module is used to fold the screen into multiple sub-screens and adjust the angles of the multiple sub-screens to the multiple optimal screen angles respectively.
[0036] In one embodiment, the acquisition module includes:
[0037] A voice collection unit, used to collect user voice, and analyze the user voice to determine whether the user voice is an adjustment command voice;
[0038] a voice direction acquisition unit, configured to acquire the direction of the adjustment command voice when the user voice is the adjustment command voice;
[0039] An image acquisition unit, used to acquire a user image of the position of the adjustment command voice;
[0040] An image recognition unit, used to perform image recognition on the user image to obtain the position of the target user who issued the adjustment command voice;
[0041] A command direction determining unit is used to determine the direction of the adjustment command according to the direction of the adjustment command voice and the direction of the target user.
[0042] In one embodiment, the voice collection unit includes:
[0043] A voice collection subunit, used for collecting the user's voice based on multiple audio collection devices;
[0044] The voice position acquisition unit comprises:
[0045] A time acquisition subunit, used for acquiring the time when the adjustment command voice arrives at each of the audio acquisition devices;
[0046] A time difference determination subunit, used to determine the arrival time difference according to the time when the adjustment command voice arrives at each of the audio acquisition devices;
[0047] The direction determining subunit is used to determine the direction of the adjustment command voice based on the arrival time difference.
[0048] In one embodiment, the user image includes multiple images; the image recognition unit includes:
[0049] a target determination subunit, configured to determine a target user who issues the adjustment command voice according to the opening and closing conditions of the mouths of each user in the plurality of user images;
[0050] The analysis subunit is used to analyze the user image to obtain the location of the target user.
[0051] In one of the embodiments, after adjusting the angles of the plurality of sub-screens to the plurality of optimal screen angles respectively, the device further comprises:
[0052] A continuous acquisition module, used for continuously acquiring user sub-images of each user corresponding to each of the sub-screens;
[0053] A target angle determination module, used to determine a target angle according to face information in each of the user sub-images;
[0054] The angle adjustment module is used to adjust the angle of each sub-screen to the target angle in real time.
[0055] In one embodiment, the device further comprises:
[0056] A first playing module is used to play the same content in the plurality of sub-screens; or
[0057] The second playing module is used to play different contents in the plurality of sub-screens.
[0058] In one embodiment, the determining module includes:
[0059] The angle determination unit is used to determine the angle opposite to the orientation of each adjustment command as the optimal screen angle.
[0060] In a third aspect, an embodiment of the present application further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program implements the steps in the above-mentioned screen angle adjustment method when executed by the processor.
[0061] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above-mentioned screen angle adjustment method are implemented.
[0062] In a fifth aspect, the embodiments of the present application further provide a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the method provided in various optional implementations described in the embodiments of the present application.
[0063] In summary, in the embodiments of the present application, the position of the screen angle adjustment command can be obtained; when there are multiple adjustment commands in different positions, multiple optimal screen angles can be determined according to the multiple positions; the screen is folded into multiple sub-screens, and the angles of the multiple sub-screens are adjusted to multiple optimal screen angles. In this way, when users in multiple positions issue screen angle adjustment commands, each sub-screen can be accurately adjusted to the optimal screen angle corresponding to each user who issues the adjustment command, thereby meeting the personalized needs of each user. BRIEF DESCRIPTION OF THE DRAWINGS
[0064] In order to more clearly illustrate the technical solutions in the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0065] Figure 1 is a schematic diagram of the steps of a screen angle adjustment method provided by an embodiment of the present application;
[0066] Figure 2 is a schematic diagram of the effect of a screen angle adjustment method provided by an embodiment of the present application;
[0067] Figure 3 is a schematic diagram of the steps of a screen angle adjustment method provided by an embodiment of the present application;
[0068] Figure 4 is a flow chart of a screen angle adjustment method provided by an embodiment of the present application;
[0069] Figure 5 is a structural schematic diagram of a screen angle adjustment device provided in an embodiment of the present application;
[0070] Figure 6 It is a schematic diagram of the structure of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION
[0071] The following will be combined with the drawings in this application to clearly and completely describe the technical solutions in this application. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments in the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.
[0072] In one embodiment, Figure 1 As shown, a screen angle adjustment method is provided. Although a logical order is shown in the step diagram, in some cases, the steps shown or described may be performed in an order different from that shown in the figure. Specifically, the screen angle adjustment method can be applied to an electronic device, wherein the electronic device may include but is not limited to one or more of a smart foldable mobile phone, a smart foldable computer, and a smart foldable TV.
[0073] It should be noted that the order of description of the following embodiments is not intended to limit the priority order of the embodiments.
[0074] according to Figure 1 The screen angle adjustment method shown in the figure includes at least steps S110 to S130, which are described in detail as follows:
[0075] In step S110 , the direction of the screen angle adjustment command is acquired.
[0076] The screen angle adjustment command is used to control the electronic device to adjust the screen angle to the optimal screen angle corresponding to the position of the adjustment command. When the user issues a screen angle adjustment command and the electronic device obtains the adjustment command, it identifies the position of the adjustment command.
[0077] The screen angle adjustment command may be a voice command and / or a gesture command, etc. Different methods may be used to identify the position of the adjustment command for different forms of adjustment commands, which will be described in detail later.
[0078] In one embodiment, the position of the adjustment command may be determined according to the adjustment command. For example, if user A issues an adjustment command, the position of the adjustment command is the angle at which A is located.
[0079] The angle adjusted by the user may be the angle formed by a straight line connecting the user and the center of the screen and the plane where the screen is located, and the angle of the adjustment command may be the angle of the user who issues the adjustment command, and the same applies to the following text.
[0080] In another embodiment, an orientation of an adjustment command may be determined according to a plurality of adjustment commands, and an angle difference between the plurality of adjustment commands is less than a preset angle.
[0081] For example, the preset angle is 5 degrees, user A and user B both issued adjustment commands, the angle of user A is 45 degrees, the angle of user B is 47 degrees, and the angle difference between user A and user B is 2 degrees, which is less than the preset angle. The direction of the adjustment command can be determined based on the respective angles of user A and user B. Specifically, the angle between user A and user B can be determined as the direction where the adjustment command is located, that is, 46 degrees can be determined as the direction where the adjustment command is located.
[0082] In step S120, when there are multiple adjustment commands in different directions, multiple optimal screen angles are determined according to the multiple directions.
[0083] In one embodiment, the adjustment commands of multiple different directions may be generated simultaneously or within a preset time range. For example, when adjustment commands are issued simultaneously from multiple different directions, it can be considered that there are adjustment commands of multiple different directions. For another example, if the preset time range is 1 minute, and within 1 minute of an adjustment command being issued from one direction, an adjustment command is also issued from another direction, it can be considered that there are adjustment commands of multiple different directions.
[0084] In another embodiment, during the entire process of screen operation, if an adjustment command with a different orientation from the previous adjustment command is generated, and the user still has the original adjustment command at the same orientation, it can be considered that there are multiple adjustment commands with different orientations.
[0085] In this case, when an adjustment command is generated in another different direction, it is identified whether there is still a user in the direction where the original adjustment command is located. If there is still a user in the direction where the original adjustment command is located, it is considered that there are multiple adjustment commands in different directions; if there is no user in the direction where the original adjustment command is located, it is considered that there is only an adjustment command in the direction where the newly generated adjustment command is located. Optionally, the user in the direction where the original adjustment command is located may be the user who issued the original adjustment command.
[0086] For each position of the adjustment command, an optimal screen angle may be determined. When there are multiple positions of the adjustment commands, multiple optimal screen angles may be determined based on the positions of the multiple adjustment commands.
[0087] In one embodiment, the number of optimal screen angles has an upper limit, which is determined according to the upper limit of the sub-screens that the screen can be folded into. For example, when the screen can be folded into a maximum of 3 sub-screens, the number of optimal screen angles is at most 3.
[0088] When the number of orientations of the adjustment commands is greater than the upper limit of the optimal screen angle, multiple target adjustment commands can be selected from the multiple adjustment commands according to the generation time of the adjustment commands of each orientation or the priority of the user who issued each adjustment command. The number of target adjustment commands is the upper limit of the optimal screen angle.
[0089] The priority of each user may be preset and stored, and the electronic device may collect images of each user and perform recognition to determine the priority of each user.
[0090] The optimal screen angle is an angle at which a user at the position of the adjustment command can easily view the screen. Therefore, the optimal screen angle can be determined according to the position of the adjustment command.
[0091] In one embodiment, determining a plurality of optimal screen angles according to the plurality of orientations may include: determining an angle directly opposite to the orientation of each adjustment command as the optimal screen angle.
[0092] The best screen angle may be an angle that makes the plane where the screen is located just face the direction of the adjustment command. Determining this angle as the best screen angle can meet the needs of most users.
[0093] In another embodiment, if the user at the position where the command is adjusted has squinting eyes, the best screen angle can be determined according to the squinting angle of the user so that the user can easily view the screen.
[0094] In step S130, the screen is folded into a plurality of sub-screens, and the angles of the plurality of sub-screens are adjusted to the plurality of optimal screen angles respectively.
[0095] The screen has a folding function. The screen can be folded along a preset axis or can be folded at will. The folding method of the screen can refer to the relevant technology, and the embodiment of the present application does not limit the folding method of the screen.
[0096] According to the number of determined optimal screen angles, the screen is folded into a plurality of sub-screens, and the angle of each sub-screen is adjusted to an optimal screen angle so that a user corresponding to the optimal screen angle can easily view the corresponding sub-screen.
[0097] As an example, Figure 2 As shown, the electronic device is a television, and two users in different positions issue screen angle adjustment commands. The number of optimal screen angles is 2. The television folds the screen into two sub-screens and adjusts the angle of each sub-screen to the optimal screen angle that allows users in the corresponding positions to easily view the sub-screen.
[0098] By adopting the technical solution of the embodiment of the present application, the position of the screen angle adjustment command can be obtained; when there are multiple adjustment commands in different positions, multiple optimal screen angles can be determined according to the multiple positions; the screen is folded into multiple sub-screens, and the angles of the multiple sub-screens are adjusted to multiple optimal screen angles. In this way, when users in multiple positions issue screen angle adjustment commands, each sub-screen can be accurately adjusted to the optimal screen angle corresponding to each user who issues the adjustment command, meeting the personalized needs of each user.
[0099] Based on the above technical solution, as an embodiment, the same content or different content can be played in multiple sub-screens.
[0100] When the same content is played on multiple sub-screens, when the screen is folded, the content played on the original screen can be scaled to each sub-screen for continued playback. When the user corresponding to each sub-screen issues an instruction to change the content played, the content played on each sub-screen can be adjusted according to the latest instruction.
[0101] For example, there are sub-screens 1 and 2, user A corresponds to sub-screen 1, and user B corresponds to sub-screen 2. When user A issues an instruction to play an animal video, both sub-screen 1 and sub-screen 2 play the same animal video; when user B issues an instruction to play a sports video, both sub-screen 1 and sub-screen 2 play the same sports video.
[0102] Optionally, when the user corresponding to each sub-screen issues an instruction to change the playing content, the priority of each user may be obtained, and the content played in each sub-screen is determined according to the instruction to change the playing content issued by the user with a higher priority.
[0103] For example, there are sub-screens 1 and 2, user A corresponds to sub-screen 1, user B corresponds to sub-screen 2, and the priority of user A is higher than the priority of user B. In the case where user A issues an instruction to play an animal video and user B issues an instruction to play a sports video, because the priority of user A is higher than the priority of user B, both sub-screen 1 and sub-screen 2 play the same animal video.
[0104] When different contents are played on multiple sub-screens, the user corresponding to each sub-screen may control the content played on the sub-screen.
[0105] Optionally, there may be multiple headphones, each of which is matched with a sub-screen. Each headphone is used to output the audio of the content played in the matched sub-screen. When different content is played in multiple sub-screens, each user can wear the headphones matched with the corresponding sub-screen to hear the audio of the content played in the sub-screen, thereby avoiding interference between the audios of the content played on each sub-screen.
[0106] Optionally, the same or different contents may be played in multiple sub-screens through preset instructions. For example, when the electronic device receives a first instruction, the same content is played in multiple sub-screens, and when the electronic device receives a second instruction, different contents are played in multiple sub-screens.
[0107] By adopting the technical solution of the embodiment of the present application, users can flexibly decide whether to play the same content in multiple sub-screens, thereby meeting different user needs. In addition, the embodiment of the present application provides different processing methods for playing the same content and playing different content, respectively, to ensure that both scenarios can be adapted.
[0108] Based on the above technical solution, as an embodiment, when the screen angle adjustment command is a gesture command, the orientation of the adjustment command can be determined by the following method: the electronic device is equipped with an image acquisition device and an image analysis module, the image acquisition device can acquire user images around the electronic device and send the user images to the image analysis module, and the image analysis module can identify whether the user image contains a user who makes a gesture command to adjust the screen angle through a human posture recognition algorithm.
[0109] Optionally, when the user image includes a user who makes a gesture command to adjust the screen angle, the image analysis module can determine the angle of the user according to the position of the user who makes the gesture command in the user image and the angle at which the image acquisition device captures the user image, and determine the orientation of the adjustment command according to the user angle. The angle at which the image acquisition device captures the user image can be transmitted to the image analysis module by the image acquisition device.
[0110] Optionally, the image analysis module may also have a built-in angle analysis neural network. When the user image includes a user who makes a gesture command to adjust the screen angle, the image analysis module may mark the user who makes the gesture command to adjust the screen angle as a target user in the user image, and input the shooting angle of the image acquisition device and the user image with the target user marked into the angle analysis neural network to obtain the angle of the target user output by the angle analysis neural network, so as to determine the direction of the adjustment command according to the angle of the target user.
[0111] On the basis of the above technical solution, as an embodiment, when the screen angle adjustment command is a voice command, the obtaining of the direction of the screen angle adjustment command may include: collecting user voice, and analyzing the user voice to determine whether the user voice is the adjustment command voice; when the user voice is the adjustment command voice, obtaining the direction of the adjustment command voice; obtaining a user image of the direction of the adjustment command voice; performing image recognition on the user image to obtain the direction of the target user who issues the adjustment command voice; and determining the direction of the adjustment command according to the direction of the adjustment command voice and the direction of the target user.
[0112] The electronic device is equipped with an audio analysis module and an audio acquisition device. The audio acquisition device can collect user voices around the electronic device in real time and transmit the collected user voices to the audio analysis module. The audio analysis module analyzes the user voices to determine whether the user voices are adjustment command voices instructing to adjust the screen angle.
[0113] When the user voice is an adjustment command voice instructing to adjust the screen angle, the audio analysis module analyzes the adjustment command voice to determine the direction of the adjustment command voice.
[0114] In one embodiment, the electronic device has multiple audio collection devices located at different positions. The collecting of user voice may include: collecting the user voice based on multiple audio collection devices; the obtaining of the direction of the adjustment command voice may include: obtaining the time when the adjustment command voice arrives at each of the audio collection devices; determining the arrival time difference according to the time when the adjustment command voice arrives at each of the audio collection devices; and determining the direction of the adjustment command voice based on the arrival time difference.
[0115] The propagation speed of speech can be considered fixed, and the same speech at the same location takes different times to reach audio collection devices at different locations. Therefore, when the audio analysis module identifies that the collected user speech is an adjustment command speech, the difference in the distance between the user who issued the adjustment command speech and each audio collection device can be determined based on the arrival time difference of the adjustment command speech at each audio collection device, and then the position of the user who issued the adjustment command speech can be determined based on the difference in distance and the positions of multiple audio collection devices, and then the direction of the adjustment command speech can be determined based on the position.
[0116] In another embodiment, the intensity of the voice will weaken with distance. Therefore, when the audio analysis module recognizes that the collected user voice is an adjustment command voice, it can determine the distance ratio of the user who issued the adjustment command voice to each audio collection device based on the intensity of the adjustment command voice collected by each audio collection device, and then determine the direction of the adjustment command voice based on the distance ratio.
[0117] In this way, the specific information of the adjustment command voice can be collected through various audio collection devices to determine the direction of the adjustment command voice.
[0118] After determining the direction of the adjustment command voice, in order to obtain a more accurate direction of the adjustment command, the direction of the target user who issued the adjustment command voice may be determined based on the user image of the direction of the adjustment command voice.
[0119] The electronic device may be provided with an image analysis module and a plurality of image acquisition devices, and the image acquisition devices may acquire user images around the electronic device in real time and send the user images to the image analysis module. After determining the position of the adjustment command voice, the target image acquisition device for acquiring the user images at the position may be determined, and the plurality of user images acquired by the target image acquisition device within the time range corresponding to the adjustment command voice may be sent to the image analysis module, and the image analysis module performs image recognition on the plurality of user images to obtain the position of the target user who issued the adjustment command voice.
[0120] Optionally, because the contents of the audios collected by the multiple audio collection devices are the same, in order to save computing resources, the audio analysis module may first identify whether the audio collected by one of the audio collection devices includes a voice command for adjusting the screen angle. When the audio analysis module identifies that the collected audio includes a voice command for adjusting the screen angle, the direction of the adjustment command voice is determined based on the adjustment command voices collected by the various audio collection devices.
[0121] In one embodiment, performing image recognition on the user image to obtain the position of the target user who issues the adjustment command voice may include: determining the target user who issues the adjustment command voice based on the opening and closing of the mouth of each user in a plurality of the user images; and analyzing the user image to obtain the position of the target user.
[0122] The image analysis module can determine the target user from the user images according to the opening and closing of the mouths of each user in the multiple user images. Optionally, the user with an open mouth in the user image can be determined as the target user. Alternatively, the mouth shape corresponding to the adjustment command voice is pre-stored, and the mouth shape of each user is determined according to the opening and closing of the mouths of each user in the multiple user images, and the similarity is calculated based on the mouth shape of the user and the mouth shape corresponding to the adjustment command voice, and the user corresponding to the mouth shape with the highest similarity is determined as the target user.
[0123] In this way, the position of the target user can be further determined by analyzing the user image, so that the position of the command voice and the position of the target user can be comprehensively adjusted to determine a more accurate position of the adjustment command.
[0124] After determining the target user, the image analysis module can determine the position of the target user based on the position of the target user in the user image and the angle at which the target image acquisition device captures the user image. The image analysis module can also have a built-in position analysis neural network. The image analysis module can mark the target user in the user image, and input the shooting angle of the image acquisition device and the user image marked with the target user into the position analysis neural network to obtain the position of the target user output by the position analysis neural network.
[0125] After obtaining the position of the target user, the position of the adjustment command voice and the position of the target user may be comprehensively adjusted to determine the position of the adjustment command. Optionally, the intermediate value between the position of the adjustment command voice and the position of the target user may be determined as the position of the adjustment command. Alternatively, when the difference between the position of the adjustment command voice and the position of the target user is less than a threshold, either the position of the adjustment command voice or the position of the target user may be determined as the position of the adjustment command.
[0126] By adopting the technical solution of the embodiment of the present application, the position of the adjustment command voice can be obtained, and then the user image can be obtained from the position of the adjustment command voice, and the user image can be analyzed. In this way, it is possible to avoid analyzing the user images in various positions, saving computing resources. Based on the position of the target user in the analyzed user image and the position of the adjustment command voice, the position of the adjustment command is comprehensively determined, which can ensure that the determined position of the adjustment command is relatively accurate, so that the optimal screen angle can be determined according to the accurate position of the adjustment command, so that the adjusted screen angle can meet the user's needs.
[0127] Based on the above technical solution, as an embodiment, Figure 3 As shown, after adjusting the angles of the plurality of sub-screens to the plurality of optimal screen angles respectively, the method may further include steps S140 to S160.
[0128] In step S140, the user sub-images of the respective users corresponding to each of the sub-screens are continuously collected;
[0129] In step S150, a target angle is determined according to the facial information in each of the user sub-images;
[0130] In step S160, the angle of each of the sub-screens is adjusted to the target angle in real time.
[0131] Users are often not completely motionless. If the user is required to issue a screen angle adjustment command again every time the user's angle changes, the user experience will be reduced. In order to improve the user's viewing experience, the user sub-image of the user corresponding to each sub-screen can be continuously collected based on the image acquisition device. The image analysis module identifies the facial information of the target user in the user sub-image, and determines the facial angle and the angle of the target user in the user sub-image. The target orientation is determined based on the facial angle, the angle of the target user in the user sub-image, and the angle at which the image acquisition device captures the user sub-image. The target angle is determined based on the target orientation. The target angle is the angle that allows the user in the target orientation to easily view the sub-screen. The angle of the sub-screen is adjusted to the target angle in real time.
[0132] In this way, the target angle can be determined in real time by analyzing the user sub-image corresponding to the sub-screen, and the angle of the sub-screen can be adjusted to the target angle in real time, so that the user can continue to watch the sub-screen easily without issuing adjustment commands after each movement, thereby improving the user experience.
[0133] On the basis of the above technical solution, a function switch may be provided. When the function switch is turned on, the above screen angle adjustment method will be executed.
[0134] Based on the above technical solution, after detecting that all users corresponding to a sub-screen have left, the angle of the sub-screen can be adjusted to the angle of an adjacent sub-screen to merge the sub-screen with the adjacent sub-screen and avoid wasting the sub-screen.
[0135] On the basis of the above technical solution, when there is only one orientation adjustment command, an optimal screen angle is determined according to the orientation, and the angle of the entire screen is directly adjusted to the optimal screen angle. The method for determining the optimal screen angle based on the orientation can refer to the above text.
[0136] As an example, Figure 4 As shown, the electronic device may be a television, the audio acquisition device may be a microphone array, and the image acquisition device may be a wide-angle camera. The user issues a voice command to adjust the orientation of the television, the microphone array captures the voice, the voice recognition determines the orientation of the voice source, the wide-angle camera captures the face data of the target user from the voice source orientation, performs face recognition on the face data to determine the position of the target user, and then determines the orientation of the adjustment command. When the orientation of the adjustment command is one command orientation, the TV screen does not fold, and when the orientation of the adjustment command is not one command orientation but two command orientations, the TV screen does not fold. The driving module of the television adjusts the orientation of the TV screen so that the angle of the TV screen is adjusted to the optimal screen angle calculated by the control module of the television, so that the screen faces the user at the optimal angle.
[0137] In order to better implement the screen angle adjustment method of the present application, the present application also provides a screen angle adjustment device based on the above screen angle adjustment method. The meanings of the terms are the same as those in the above screen angle adjustment method, and the specific implementation details can refer to the description in the method embodiment.
[0138] See also Figure 5 , Figure 5 : is a structural schematic diagram of a screen angle adjustment device provided in an embodiment of the present application, the screen angle adjustment device comprising:
[0139] An acquisition module 501 is used to acquire the position of a screen angle adjustment command;
[0140] A determination module 502, configured to determine a plurality of optimal screen angles according to the plurality of orientations when there are a plurality of adjustment commands in different orientations;
[0141] The adjustment module 503 is used to fold the screen into multiple sub-screens and adjust the angles of the multiple sub-screens to the multiple optimal screen angles respectively.
[0142] In one embodiment, the acquisition module 501 includes:
[0143] A voice collection unit, used to collect user voice, and analyze the user voice to determine whether the user voice is an adjustment command voice;
[0144] a voice direction acquisition unit, configured to acquire the direction of the adjustment command voice when the user voice is the adjustment command voice;
[0145] An image acquisition unit, used to acquire a user image of the position of the adjustment command voice;
[0146] An image recognition unit, used to perform image recognition on the user image to obtain the position of the target user who issued the adjustment command voice;
[0147] A command direction determining unit is used to determine the direction of the adjustment command according to the direction of the adjustment command voice and the direction of the target user.
[0148] In one embodiment, the voice collection unit includes:
[0149] A voice collection subunit, used for collecting the user's voice based on multiple audio collection devices;
[0150] The voice position acquisition unit comprises:
[0151] A time acquisition subunit, used for acquiring the time when the adjustment command voice arrives at each of the audio acquisition devices;
[0152] A time difference determination subunit, used to determine the arrival time difference according to the time when the adjustment command voice arrives at each of the audio acquisition devices;
[0153] The direction determining subunit is used to determine the direction of the adjustment command voice based on the arrival time difference.
[0154] In one embodiment, the user image includes multiple images; the image recognition unit includes:
[0155] a target determination subunit, configured to determine a target user who issues the adjustment command voice according to the opening and closing conditions of the mouths of each user in the plurality of user images;
[0156] The analysis subunit is used to analyze the user image to obtain the location of the target user.
[0157] In one of the embodiments, after adjusting the angles of the plurality of sub-screens to the plurality of optimal screen angles respectively, the device further comprises:
[0158] A continuous acquisition module, used for continuously acquiring user sub-images of each user corresponding to each of the sub-screens;
[0159] A target angle determination module, used to determine a target angle according to face information in each of the user sub-images;
[0160] The angle adjustment module is used to adjust the angle of each sub-screen to the target angle in real time.
[0161] In one embodiment, the device further comprises:
[0162] A first playing module is used to play the same content in the plurality of sub-screens; or
[0163] The second playing module is used to play different contents in the plurality of sub-screens.
[0164] In one embodiment, the determining module 502 includes:
[0165] The angle determination unit is used to determine the angle opposite to the orientation of each adjustment command as the optimal screen angle.
[0166] By adopting the technical solution of the embodiment of the present application, the position of the screen angle adjustment command can be obtained; when there are multiple adjustment commands in different positions, multiple optimal screen angles can be determined according to the multiple positions; the screen is folded into multiple sub-screens, and the angles of the multiple sub-screens are adjusted to multiple optimal screen angles. In this way, when users in multiple positions issue screen angle adjustment commands, each sub-screen can be accurately adjusted to the optimal screen angle corresponding to each user who issues the adjustment command, meeting the personalized needs of each user.
[0167] For the specific definition of the screen angle adjustment device, please refer to the definition of the screen angle adjustment method above, which will not be repeated here. Each module in the above-mentioned screen angle adjustment device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.
[0168] In addition, the present application also provides an electronic device, such as Figure 6 As shown, it shows a schematic diagram of the structure of the electronic device involved in this application, specifically:
[0169] The electronic device may include one or more processors 601 of processing cores and one or more computer-readable storage media memories 602 and other components. Those skilled in the art will appreciate that Figure 6 The electronic device structure shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.
[0170] The processor 601 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. By running or executing software programs and / or modules stored in the memory 602, and calling data stored in the memory 602, it performs various functions of the electronic device and processes data, thereby monitoring the electronic device as a whole. Optionally, the processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 601.
[0171] The memory 602 can be used to store software programs and modules. The processor 601 executes various functional applications and data processing by running the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 602 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 602 may also include a memory controller to provide the processor 601 with access to the memory 602.
[0172] In one embodiment, the electronic device further includes a power supply 603 for supplying power to various components. Preferably, the power supply 603 can be logically connected to the processor 601 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. The power supply 603 can also include any components such as one or more DC or AC power supplies, recharging systems, power supply device debugging circuits, power converters or inverters, and power status indicators.
[0173] In one embodiment, the electronic device may further include an input unit 604, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.
[0174] Although not shown, the electronic device may further include a display unit, etc., which will not be described in detail herein. Specifically in this embodiment, the processor 601 in the electronic device will load the executable files corresponding to the processes of one or more application programs into the memory 602 according to the following instructions, and the processor 601 will run the application programs stored in the memory 602, thereby implementing the steps in any of the screen angle adjustment methods provided in the embodiments of the present application.
[0175] Those skilled in the art will understand that Figure 6 The structure shown in the figure is merely a block diagram of a partial structure related to the scheme of the present application, and does not constitute a limitation on the electronic device to which the scheme of the present application is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.
[0176] In one embodiment, an electronic device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the method described in any embodiment of the present application is implemented.
[0177] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the method described in any embodiment of the present application is implemented.
[0178] In some embodiments, a computer program product is also proposed, including a computer program or instructions, which implement the method described in any embodiment of the present application when executed by a processor.
[0179] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.
[0180] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.
[0181] To this end, the present application provides a computer-readable storage medium, on which a computer program is stored. The computer program can be loaded by a processor to execute the steps in any screen angle adjustment method provided in the present application.
[0182] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.
[0183] The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.
[0184] Since the instructions stored in the computer-readable storage medium can execute the steps in any screen angle adjustment method provided in the present application, the beneficial effects that can be achieved by any screen angle adjustment method provided in the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.
[0185] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "including one..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.
[0186] The above is a detailed introduction to a screen angle adjustment method, device, electronic device and computer-readable storage medium provided by the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.
Claims
1. A screen angle adjustment method, characterized in that: include: Get the position of the screen angle adjustment command; When there are multiple adjustment commands in different directions, determining multiple optimal screen angles according to the multiple directions; as well as The screen is folded into a plurality of sub-screens, and the angles of the plurality of sub-screens are respectively adjusted to the plurality of optimal screen angles.
2. The method according to claim 1, characterized in that The obtaining the position of the screen angle adjustment command includes: Collecting user voice, and analyzing the user voice to determine whether the user voice is an adjustment command voice; When the user voice is the adjustment command voice, obtaining the direction of the adjustment command voice; Acquire a user image of the position of the adjustment command voice; Performing image recognition on the user image to obtain the position of the target user who issued the adjustment command voice; The direction of the adjustment command is determined according to the direction of the adjustment command voice and the direction of the target user.
3. The method according to claim 2, characterized in that The collecting of user voice includes: Based on multiple audio collection devices, collect the user voice; The obtaining the position of the adjustment command voice includes: Obtaining the time when the adjustment command voice arrives at each of the audio acquisition devices; Determine the arrival time difference according to the time when the adjustment command voice arrives at each of the audio collection devices; Based on the arrival time difference, the direction of the adjustment command voice is determined.
4. The method according to claim 2, characterized in that: The user images include a plurality of images; and performing image recognition on the user images to obtain the position of the target user who issues the adjustment command voice includes: Determining a target user who issues the adjustment command voice according to the opening and closing conditions of the mouths of each user in the plurality of user images; The user image is analyzed to obtain the location of the target user.
5. The method according to claim 1, characterized in that: After adjusting the angles of the plurality of sub-screens to the plurality of optimal screen angles respectively, the method further comprises: Continuously collecting user sub-images of each user corresponding to each of the sub-screens; Determining a target angle according to facial information in each of the user sub-images; The angle of each of the sub-screens is adjusted to the target angle in real time.
6. The method according to claim 1, characterized in that The method further comprises: Play the same content in the multiple sub-screens; or Different contents are played in the plurality of sub-screens.
7. The method according to claim 1, characterized in that Determining a plurality of optimal screen angles according to the plurality of orientations comprises: The angle directly opposite to the orientation of each adjustment command is determined as the optimal screen angle.
8. A screen angle adjustment device, characterized in that: include: An acquisition module, used for acquiring the position of the screen angle adjustment command; A determination module, configured to determine a plurality of optimal screen angles according to the plurality of orientations when there are a plurality of adjustment commands in different orientations; The adjustment module is used to fold the screen into multiple sub-screens and adjust the angles of the multiple sub-screens to the multiple optimal screen angles respectively.
9. An electronic device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps in the screen angle adjustment method as described in any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the screen angle adjustment method according to any one of claims 1 to 7 are implemented.
Citation Information
Patent Citations
Information processing method and electronic device
CN104572004A
Screen orientation angle adjusting method and device, electronic product and storage medium
CN111142836A
Flexible scroll screen display method and system, intelligent terminal and storage medium thereof
CN116820371A
Conference system capable of realizing screen sharing
CN209895191U
Self-adjusting curved display screen
US20200111441A1