A display content adjustment method and system

Abstract

An embodiment of the present specification provides a method and system for adjusting display content, the method comprising: determining a relative relationship between a user and a display screen, wherein the relative relationship comprises at least one of a viewing distance between the user and the display screen, a position of a reference point on the display screen that satisfies a preset condition from a first preset point of the user, and a viewing angle of the user when viewing a target viewing picture on the display screen; and adjusting the target viewing picture based on the relative relationship.

Description

Technical Field

[0001] The present invention relates to the field of display technology, and in particular to a display content adjustment method and system. Background Art

[0002] For devices that require visual operations, due to different installation locations of the devices and differences in users' heights and sitting postures, different users have different sight angles, resulting in inconsistent user experiences.

[0003] Therefore, it is hoped to propose a display content adjustment method and system that can adjust the display content according to different viewing situations of users, so that users can achieve better viewing effects at different positions or viewing angles, thereby improving the user experience. Summary of the invention

[0004] One of the embodiments of the present specification provides a method for adjusting display content. The method for adjusting display content includes: determining a relative relationship between a user and a display screen, wherein the relative relationship includes at least one of a viewing distance between the user and the display screen, a position of a reference point on the display screen that satisfies a preset condition from a first preset point of the user, and a viewing angle when the user views a target viewing picture on the display screen; and adjusting the target viewing picture based on the relative relationship.

[0005] One of the embodiments of the present specification provides a display content adjustment system. The display content adjustment system includes: a determination module, used to determine the relative relationship between the user and the display screen, wherein the relative relationship includes at least one of the viewing distance between the user and the display screen, the position of a reference point on the display screen that satisfies a preset condition from a first preset point of the user, and the viewing angle of the user when viewing a target viewing picture on the display screen; and an adjustment module, used to adjust the target viewing picture based on the relative relationship.

[0006] One of the embodiments of this specification provides a display content adjustment device, which includes at least one processor and at least one memory; the at least one memory is used to store computer instructions; the at least one processor executes at least part of the computer instructions to implement a display content adjustment method.

[0007] One of the embodiments of the present specification provides a computer-readable storage medium, wherein the storage medium stores computer instructions. When a computer reads the computer instructions in the storage medium, the computer executes a display content adjustment method. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] This specification will be further described in the form of exemplary embodiments, which will be described in detail by the accompanying drawings. These embodiments are not restrictive, and in these embodiments, the same number represents the same structure, wherein:

[0009] Figure 1 is a schematic diagram of an application scenario of a display content adjustment system according to some embodiments of this specification;

[0010] Figure 2 is an exemplary module diagram of a display content adjustment system according to some embodiments of this specification;

[0011] Figure 3 is an exemplary flow chart of a method for adjusting display content according to some embodiments of this specification;

[0012] Figure 4 is an exemplary flow chart of deforming a target viewing picture based on deformation parameters according to some embodiments of this specification;

[0013] Figure 5 is an exemplary flow chart of scaling a target viewing picture based on a scaling parameter according to some embodiments of this specification;

[0014] Figure 6a is an exemplary schematic diagram of not deforming a target viewing picture based on deformation parameters according to some embodiments of this specification;

[0015] Figure 6b is an exemplary schematic diagram of deforming a target viewing picture based on deformation parameters according to some embodiments of this specification;

[0016] Figure 6c is another exemplary schematic diagram of deforming a target viewing picture based on deformation parameters according to some embodiments of this specification;

[0017] Figure 7a is an exemplary schematic diagram of reducing a target viewing picture based on a zoom parameter according to some embodiments of this specification;

[0018] Figure 7b is an exemplary schematic diagram of not scaling a target viewing picture based on a scaling parameter according to some embodiments of this specification;

[0019] Figure 7c is an exemplary schematic diagram of enlarging a target viewing picture based on a zoom parameter according to some embodiments of this specification;

[0020] Figure 8 is an exemplary schematic diagram of adjusting the main viewing content to the main display position according to some embodiments of this specification;

[0021] Figure 9a is an exemplary schematic diagram of a standard viewing angle according to some embodiments of this specification;

[0022] Figure 9b is an exemplary schematic diagram of a horizontally offset viewing angle according to some embodiments of this specification;

[0023] Fig.9c is an exemplary schematic diagram of a vertically offset viewing angle according to some embodiments of the present specification. DETAILED DESCRIPTION

[0024] In order to more clearly illustrate the technical solutions of the embodiments of this specification, the following is a brief introduction to the drawings required for the description of the embodiments. Obviously, the drawings described below are only some examples or embodiments of this specification. For ordinary technicians in this field, this specification can also be applied to other similar scenarios based on these drawings without creative work. Unless it is obvious from the language environment or otherwise explained, the same reference numerals in the figures represent the same structure or operation.

[0025] It should be understood that the "system", "device", "unit" and / or "module" used herein are a method for distinguishing different components, elements, parts, portions or assemblies at different levels. However, if other words can achieve the same purpose, the words can be replaced by other expressions.

[0026] As shown in this specification and claims, unless the context clearly indicates an exception, the words "a", "an", "an" and / or "the" do not refer to the singular and may also include the plural. Generally speaking, the terms "comprise" and "include" only indicate the inclusion of the steps and elements that have been clearly identified, and these steps and elements do not constitute an exclusive list. The method or device may also include other steps or elements.

[0027] Flowcharts are used in this specification to illustrate the operations performed by the system according to the embodiments of this specification. It should be understood that the preceding or following operations are not necessarily performed precisely in order. Instead, the steps may be processed in reverse order or simultaneously. At the same time, other operations may also be added to these processes, or one or more operations may be removed from these processes.

[0028] Figure 1 It is a schematic diagram of an application scenario of a display content adjustment system according to some embodiments of this specification.

[0029] In some embodiments, the display content adjustment system can be used to adjust the target viewing image based on the relative relationship between the user and the display screen. Figure 1As shown, the application scenario 100 of the display content adjustment system may include a processor 110 , a display screen 120 and a user 130 .

[0030] The processor 110 can be used to perform one or more functions disclosed in one or more embodiments of this specification. For example, the processor 110 can be used to determine the relative relationship between the user 130 and the display screen 120. For another example, the processor 110 can be used to adjust the target viewing screen based on the relative relationship. In some embodiments, the processor 110 can be used to receive images captured and recorded by a camera and / or information sensed by a sensor (such as an infrared sensor, a distance sensor, etc.), and the image and / or information are used to determine the relative relationship between the user 130 and the display screen 120. In some embodiments, the processor 110 can send the adjusted display content to the display screen 120. In some embodiments, the processor 110 can be part of a terminal (such as a computer or a mobile phone, etc.) to which the display screen belongs. In some embodiments, the processor 110 can be independent of the terminal to which the display screen belongs and connected to the display screen 120 by wire and / or wireless means. For example, the processor 110 can be remote and located on a server.

[0031] The display screen 120 can be used to display the user's target viewing screen 121. In some embodiments, the target viewing screen 121 in the display screen 120 can be adjusted according to the relative relationship between the display screen 120 and the user. As an example only, when the user 130 is located directly in front of the display screen and looks up at the midpoint of the display screen 120, the content displayed on the display screen is the target viewing screen 1211. Among them, the content in the target viewing screen 1211 is the target viewing screen that has not been deformed. When the user 130 needs to look down at the display screen 120, the content displayed on the display screen 120 is the target viewing screen 1212. The content in the target viewing screen 1212 is the deformed screen of the target viewing screen 1211. By deforming the target viewing screen 121, it can be ensured that the effect of the user looking down at the target viewing screen and the effect of looking up at the target viewing screen are not much different.

[0032] In some embodiments, the display screen 120 can be a part of a terminal (such as a computer, a television, a tablet, an embedded device, etc.). In some embodiments, the terminal may also include a projection-type device, etc., and the display screen may refer to a projection screen of a projection-type device, etc. The terminal may be provided with monitoring devices such as a camera and a sensor. In some embodiments, the terminal may be a combination of at least two of the above-mentioned devices. The display screen may refer to the display screens of the at least two devices. The processor 110 may be used to adjust the target viewing screen in the display screens of the at least two devices based on the relative relationship between the display screens of the at least two devices and the user, thereby realizing a display matrix. The display matrix may refer to at least two display screens arranged in a matrix. In some embodiments, the shape of the display screen may include various shapes. In addition to the above-mentioned Figure 1 The rectangle shown, the shape of the display screen can also include a square, a circle, an irregular polygon, etc. This specification mainly takes a rectangle as an example for description.

[0033] A user may refer to a person who has a need to watch the content of the display screen 120 in front of the display screen. The user may be a single person or multiple people. For more information about users, see Figure 3 Related description.

[0034] Figure 2 2 is an exemplary module diagram of a display content adjustment system according to some embodiments of the present specification. In some embodiments, the display content adjustment system 200 may include a determination module 210 and an adjustment module 220.

[0035] In some embodiments, the determination module 210 can be used to determine the relative relationship between the user and the display screen, wherein the relative relationship includes at least one of the viewing distance between the user and the display screen, the position of a reference point on the display screen that satisfies a preset condition from a first preset point of the user, and the viewing angle of the user when viewing the target viewing screen on the display screen.

[0036] In some embodiments, the adjustment module 220 may be used to adjust the target viewing picture based on the relative relationship.

[0037] In some embodiments, the user may be a primary user among multiple candidate users, and the determination module 210 may also be used to determine the primary user from the multiple candidate users.

[0038] In some embodiments, the determination module 210 may be used to determine a relative relationship based on a first image of the user captured by a camera on the display screen and a second image captured by a global camera in the space where the display screen is located for capturing the display screen and the user.

[0039] In some embodiments, the adjustment module 220 may also be used to determine deformation parameters of the target viewing picture based on the viewing angle and the standard viewing angle; and deform the target viewing picture based on the deformation parameters.

[0040] In some embodiments, the adjustment module 220 can also be used to process the viewing angle and the standard angle through a deformation parameter determination model to determine the deformation parameters, wherein the deformation parameter determination model is a machine learning model. The deformation parameter determination model inputs the first image and the second image, and outputs the deformation parameters.

[0041] In some embodiments, the adjustment module 220 may also be configured to determine the viewing angle determined when the user is looking straight ahead as the standard viewing angle.

[0042] In some embodiments, the adjustment module 220 may also be used to determine a scaling parameter of the target viewing picture based on the viewing distance; and scale the target viewing picture based on the scaling parameter.

[0043] In some embodiments, the adjustment module 220 may also be used to determine a zoom-out parameter or a zoom-in parameter based on a difference between the viewing distance and a preset distance, wherein the zoom-out parameter or the zoom-in parameter is positively correlated with an absolute value of the difference.

[0044] In some embodiments, the adjustment module 220 can also be used to determine the scaling parameters through a scaling parameter determination model, wherein the scaling parameter determination model is a machine learning model, the scaling parameter determination model input is the first image and the second image, and the output is the scaling parameters.

[0045] In some embodiments, the adjustment module 220 may also be used to determine the main viewing content from the target viewing picture; determine the main display position of the display screen based on the position of the reference point; and adjust the main viewing content to the main display position.

[0046] In some embodiments, the adjustment module 220 can also be used to obtain the user's first sequence and second sequence, wherein the first sequence includes a sequence of historical control parameters of the remote control at multiple time points, and the second sequence includes a sequence of historical display contents of the display screen at multiple time points; based on the first sequence and the second sequence, the main viewing content is determined.

[0047] In some embodiments, the adjustment module 220 may be configured to process the first sequence and the second sequence through a content prediction model to determine the main viewing content.

[0048] It should be understood that Figure 2 The display content adjustment system and its modules shown can be implemented in various ways. For example, in some embodiments, the system and its modules can be implemented by hardware, software, or a combination of software and hardware.

[0049] It should be noted that the above description of the display content adjustment system and its modules is only for convenience of description and does not limit the present specification to the scope of the embodiments. It is understandable that, after understanding the principle of the system, those skilled in the art may arbitrarily combine the modules or form a subsystem to connect with other modules without deviating from the principle. In some embodiments, Figure 2 The determination module and adjustment module disclosed in the specification may be different modules in a system, or one module may realize the functions of two or more modules. For example, each module may share a storage module, or each module may have its own storage module. Such variations are within the scope of protection of this specification.

[0050] Figure 3 is an exemplary flow chart of a method for adjusting display content according to some embodiments of this specification. In some embodiments, process 300 may be executed by processor 110. Figure 3 As shown, process 300 includes the following steps:

[0051] Step 310 , determining the relative relationship between the user and the display screen. In some embodiments, step 310 may be performed by the determination module 210 .

[0052] Different users may be at different positions in front of the display screen, for example, different users may be at different distances from the display screen, or different users may be at different positions on the display screen.

[0053] In some embodiments, there may be multiple candidate users in front of the display screen. The candidate user may refer to a person in front of the display screen. The user may be a primary user among the multiple candidate users. The primary user may refer to a person in front of the display screen who has a need to watch the content of the display screen. The primary user may be one person or multiple people.

[0054] In some embodiments, the determination module 210 can determine the main user from multiple candidate users. For example, the determination module 210 can identify the person watching the display screen from multiple candidate users by identifying the image captured by the camera, and determine the person watching the display screen as the main user, wherein the camera can be located on the display screen to capture the candidate users in front of the display screen. For another example, the determination module 210 can use the candidate user closest to the display screen detected by the infrared sensor as the main user. It should be noted that the embodiments of this specification do not limit the method of determining the main user. For example, the determination module 210 can identify the image captured by the camera, and determine the person operating the display screen as the main user, etc.

[0055] The relative relationship may refer to the relationship between the user and the display screen. The relative relationship may be a relationship of distance, angle, orientation, etc. In some embodiments, the relative relationship may include a viewing distance between the user and the display screen.

[0056] The viewing distance may refer to the distance between the user and the display screen when the user is viewing the display screen. In some embodiments, the viewing distance may be the vertical distance between the user and the display screen. For example, the vertical distance of a point of the user (e.g., the first preset point, etc.) relative to the surface where the display screen is located. In some embodiments, the viewing distance may be the straight-line distance between a point of the user (e.g., the first preset point, etc.) and a point of the display screen (e.g., the reference point, the second preset point, etc.). For example, the straight-line distance between the user's eyes and the center of the display screen, the straight-line distance between the user's eyes and the point on the display screen closest to the user, etc.

[0057] The first preset point may refer to a part of the user that is set in advance, such as the user's head or the user's eyes.

[0058] In some embodiments, the first preset point is related to the eye position of the user. For example, the first preset point is the center position of the user's eye (left eye or right eye), the center position of the line between the eyes, etc. In some embodiments, the determination module 210 can determine the eye position of the user by identifying the image of the user captured by the camera, and then determine the first preset point.

[0059] The second preset point may refer to a certain position of the display screen set in advance. For example, the center position of the display screen, or the position where the display screen plays the main viewing content, etc. In some embodiments, the second preset point may include a reference point. The reference point may be a point on the display screen whose distance from the first preset point meets a preset condition. The preset condition may be the closest distance, the distance is less than a threshold, the angle with the horizontal plane is the smallest, etc. For example, the reference point may be the point on the display screen that is closest to the first preset point of the user.

[0060] like Figure 6a As shown, the first preset point of the user is the user's eye o1. The user's eye o1 and the point q1 in the display screen (such as the center of the display screen) are located on the same horizontal plane. The user looks straight at the display screen. The vertical distance between the user and the display screen is D1. The straight-line distance between the user's eye o1 and the point q1 in the display screen is also D1.

[0061] like Figure 6b As shown, the user looks up at the display screen. The vertical distance between the user and the display screen is D1. The straight-line distance between the user's eye o2 and the point q2 in the display screen is D2.

[0062] like Figure 6cAs shown, the user looks down at the display screen. The vertical distance between the user and the display screen is D1. The straight-line distance between the user's eye o3 and the point q3 in the display screen is D3.

[0063] Figure 6a , Figure 6b and Figure 6c The straight-line distance between the first preset point of the user and the point on the display screen is only an example, and the straight-line distance may be the distance between other parts of the user and other positions on the display screen.

[0064] In some embodiments, the relative relationship may include the position of a reference point on the display screen that satisfies a preset condition from the user's first preset point. For the description of the reference point and the preset condition, see the above.

[0065] In some embodiments, the relative relationship may include a viewing angle when the user views the target viewing picture in the display screen.

[0066] The target viewing screen refers to the screen in the area viewed by the user in the display screen. In some embodiments, the target viewing screen may refer to all or part of the screen in the display screen. When the target viewing screen is a partial screen, the target viewing screen may be located in different areas of the display screen, for example, the center area of ​​the display screen, the lower right corner area of ​​the display screen, etc.

[0067] The viewing angle may refer to the angle of the user's line of sight when the user views the target viewing picture on the display screen. The viewing angle may be represented in a variety of ways. For example, the angle between the line between the user's eyes and the target viewing picture (e.g., the center point of the target viewing picture) and the display screen may be used as the viewing angle. In this case, the greater the difference between the angle and 90°, the worse the viewing angle.

[0068] The determination module 210 can determine the relative relationship between the user and the display screen in a variety of ways. For example, the determination module 210 can determine the viewing distance between the user and the display screen by a distance measurement method. The distance measurement method may include a millimeter wave radar ranging method, in which the display screen includes a built-in radar system (the system can transmit electromagnetic wave signals), and the electromagnetic wave signals are blocked by objects on its transmission path and then reflected. The radar system can determine the distance between the objects by capturing the reflected signals, thereby determining the viewing distance between the user and the display screen. For another example, the determination module 210 can determine the user's first preset point by image recognition technology, and further determine the position of the reference point in combination with the shape and position of the display screen, wherein the shape and position of the display screen can be stored in advance in the memory of the processor. For another example, the determination module 210 can determine the viewing angle of the user when viewing the target viewing screen in the display screen by a line of sight detection method. For example, a built-in or external camera in the display screen can obtain images of the user and the display screen, and the acquired images are analyzed using image recognition technology to determine the viewing angle of the user when viewing the target viewing screen in the display screen.

[0069] In some embodiments, the relative relationship can be determined by a first image and a second image captured by a camera. The first image refers to an image of the user captured by a camera on a display screen. The second image refers to an image captured by a global camera in the space where the display screen is located for capturing the display screen and the user. In some embodiments, the first image and the second image are analyzed by image recognition technology, so that the relative relationship between the user and the display screen can be determined. For example, by performing image recognition on the first image, the viewing angle of the user when viewing the target viewing screen in the display screen is determined. For another example, by performing image recognition on the second image, the distance between the user and the display screen in the image is converted into the real distance, so that the viewing distance between the user and the display screen can be determined. For another example, by performing image recognition on the second image, the position of a reference point on the display screen that meets a preset condition from the first preset point of the user is determined.

[0070] By capturing images of the user and the entire environment through a camera to obtain images from multiple angles, the relative relationship between the user and the display screen can be determined from both the user's viewing angle and the distance between the user and the display screen, thereby achieving the effect of convenient and efficient image acquisition and more accurate output of relative relationship results.

[0071] In some embodiments, if there are multiple users or multiple main users, the determination module 210 may determine the relative relationship between each user or each main user and the display screen, and then fuse the relative relationships of each user or each main user to determine the final relative relationship. The fusion may be: averaging, weighted averaging, etc. The weight may be determined based on the importance of the user. For example, the weight of the main user is greater than the weight of the user. For another example, the weight of the main user who is farther away from the display screen is lower, etc.

[0072] Step 320 , based on the relative relationship, adjust the target viewing picture. In some embodiments, step 320 may be performed by the adjustment module 220 .

[0073] In some embodiments, the adjustment module 220 can automatically deform, scale, move the target viewing picture of the display screen based on the relative relationship between the user and the display screen. For example, when the viewing distance between the user and the display screen is far or close, the adjustment module 220 can automatically enlarge or reduce the target viewing picture of the display screen. For another example, when the offset viewing angle between the user and the display screen is large, the adjustment module 220 can automatically adjust the deformation parameters of the target viewing picture. In some embodiments, the adjustment module 220 can adjust other supporting components of the terminal of the display screen based on the relative relationship between the user and the display screen. For example, when the viewing distance between the user and the display screen is far, the adjustment module 220 can automatically increase the sound of the sound-emitting unit (such as a speaker, etc.). Through the enlarged target viewing picture and the increased sound, the user can experience better audio-visual effects even if the viewing distance between the user and the display screen is far.

[0074] In some embodiments, the adjustment module 220 may determine the deformation parameters of the target viewing picture based on the viewing angle and the standard viewing angle, and deform the target viewing picture based on the deformation parameters. For more information about the standard viewing angle and adjusting the target viewing picture based on the deformation parameters, see Figure 4 and its related description.

[0075] In some embodiments, the adjustment module 220 may determine a scaling parameter of the target viewing picture based on the viewing distance, and scale the target viewing picture based on the scaling parameter. For more information on adjusting the target viewing picture based on the scaling parameter, see Figure 5 and its related description.

[0076] In some embodiments, the adjustment module 220 can determine the main viewing content from the target viewing picture, determine the main display position of the display screen based on the position of the reference point, and adjust the main viewing content to the main display position. For more information about adjusting the target viewing picture based on the display position, see Figure 8 and its related description.

[0077] In some embodiments of the present specification, the relative relationship between the user and the display screen is considered by factors such as the viewing distance and viewing angle between the user and the display screen, so that the target viewing image is intelligently adjusted by deformation, scaling, movement, etc., so that the user can achieve a better viewing effect at different positions or viewing angles, thereby improving the user experience.

[0078] Figure 4 FIG. 1 is an exemplary flow chart of deforming a target viewing picture based on deformation parameters according to some embodiments of this specification. Figure 4 As shown, the process 400 includes the following steps. In some embodiments, the process 400 may be executed by the adjustment module 220 .

[0079] Step 410: Determine deformation parameters of the target viewing picture based on the viewing angle and the standard viewing angle.

[0080] The standard viewing angle may refer to a viewing angle in which a user looks straight ahead.

[0081] In some embodiments, when the line between the user's eyes and the target viewing image is perpendicular to the display screen, the viewing angle at this time is a standard viewing angle; when the line between the user's eyes and the target viewing image is not perpendicular to the display screen, the viewing angle at this time is offset from the standard viewing angle. Figure 6a As shown, the user's first preset point is the line connecting the user's eye o1 and the target viewing point q1, which is perpendicular to the display screen. At this time, the user's viewing angle o1q1 is a standard viewing angle. Figure 6b As shown in FIG. 1 , the line connecting the user's eye o2 and the target viewing point q2 is not perpendicular to the display screen. At this time, the user's viewing angle o2q2 is not a standard angle, and the standard angle is o2p2. Figure 6c As shown, the line connecting the user's eye o3 and the point q3 of the target viewing picture is not perpendicular to the display screen. At this time, the user's viewing angle o3q3 is not a standard angle, and the standard angle is o3p3.

[0082] As mentioned above, the user's viewing angle may be offset from the standard viewing angle. In some embodiments, the offset of the viewing angle from the standard viewing angle may be represented by an offset angle. For example, the offset angle may be represented by the angle between the viewing angle and the standard viewing angle. In this case, the larger the absolute value of the offset angle, the more serious the offset. Figure 6b As shown in , the offset viewing angle is Φ. Figure 6c As shown, the offset viewing angle is Ψ. If the standard viewing angle is taken as the positive x direction, then Φ is a positive angle and Ψ is a negative angle. For another example, the offset viewing angle can be represented by the angle between the viewing angle and the display screen.

[0083] In some embodiments, the offset viewing angle may include a horizontal offset viewing angle and a vertical offset viewing angle, etc. The horizontal offset viewing angle may refer to the angle at which the user is not at the center position in front of the target viewing screen, and is offset to the left or right of the target viewing screen. The adjustment module 220 may preset the positive and negative values ​​of the horizontal offset viewing angle. For example, the angle at which the user is offset to the left of the target viewing screen is a positive angle. The angle at which the user is offset to the right of the target viewing screen is a negative angle. The vertical offset viewing angle may refer to the angle at which the user's viewing angle is higher or lower when the user is not at the center position in front of the target viewing screen. The user needs to look down or look up to view the target viewing screen in the display screen. The adjustment module 220 may preset the positive and negative values ​​of the vertical offset viewing angle. For example, a positive angle is when the user's viewing angle is higher. A negative angle is when the user's viewing angle is lower. The size of the offset viewing angle may be represented by an angle. The larger the absolute value of the offset viewing angle, the more the user deviates from the center position in front of the target viewing screen.

[0084] In some embodiments, the adjustment module 220 can determine the size of the offset viewing angle by connecting the first preset point of the user and the endpoints in the target viewing picture. For example, if the distances between the two endpoints on the horizontal line relative to the user in the target viewing picture and the first preset point are not equal, it means that there is a left-right offset, and the horizontal offset viewing angle is not 0; if the distances between the two endpoints on the vertical line relative to the user in the target viewing picture and the first preset point are not equal, it means that there is an up-down offset, and the vertical offset viewing angle is not 0.

[0085] Figure 9a is an exemplary schematic diagram of a standard viewing angle according to some embodiments of this specification. Figure 9a As shown, the user's viewing angle is at the standard viewing angle, and the line segment lengths of the lines connecting the user's first preset point and the four endpoints m1, m2, m3 and m4 in the target viewing picture are all equal, that is, the line segment distances of d1, d2, d3 and d4 are all equal. The user's viewing angle is not offset relative to the standard viewing angle. At this time, the user's horizontal offset viewing angle and vertical offset viewing angle are both 0°.

[0086] Figure 9b FIG. 1 is an exemplary schematic diagram of a horizontally offset viewing angle according to some embodiments of the present specification. Figure 9bAs shown, the user's viewing angle deviates from the standard viewing angle. The user deviates to the right of the target viewing screen, without deviating up or down. The length of the line segment of the user's first preset point and the target viewing screen relative to the two endpoints on the user's horizontal line is not equal, and the length of the line segment relative to the two endpoints on the user's vertical line is equal. That is, d1 is equal to d3, d2 is equal to d4, d1 is not equal to d2, d3 is not equal to d4, and the difference between d1 and d2 is the same as the difference between d3 and d4. The user's vertical offset viewing angle is 0°, and the horizontal offset viewing angle is not 0°. The greater the degree to which the user's viewing angle deviates to the left or right of the target viewing screen, the greater the difference between d1 and d2, and d3 and d4. The adjustment module 220 can determine the horizontal offset viewing angle by the difference between d1 and d2, or d3 and d4, and the distance between the corresponding two endpoints. For example, the horizontal offset viewing angle can be calculated by formula (1):

[0087] α=arcsin((d1-d2) / m1m2) (1)

[0088] Wherein, α is the horizontal offset viewing angle; d1 and d2 are respectively the distances between the user's first preset point and the line connecting the endpoints m1 and m2 in the target viewing picture; and m1m2 is the distance between the line connecting the endpoints m1 and m2 in the target viewing picture.

[0089] Fig.9c FIG. 1 is an exemplary schematic diagram of a vertically offset viewing angle according to some embodiments of the present specification. Fig.9c As shown, the user offsets to the bottom of the target viewing screen, without offsetting to the left or right. The length of the line segment between the user's first preset point and the target viewing screen relative to the two endpoints on the vertical line of the user is not equal. The length of the line segment relative to the two endpoints on the horizontal line of the user is equal. That is, d1 is equal to d2, d3 is equal to d4, d1 is not equal to d3, and d2 is not equal to d4. The difference between d1 and d3 is the same as the difference between d2 and d4. The user's horizontal offset viewing angle is 0°, and the vertical offset viewing angle is not 0°. The greater the degree to which the user's viewing angle is offset to the top or bottom of the target viewing screen, the greater the difference between d1 and d3, and d2 and d4. The adjustment module 220 can determine the vertical offset viewing angle by the difference between d1 and d3, or between d2 and d4, and the distance between the corresponding two endpoints. The vertical offset viewing angle can be calculated by formula (2):

[0090] β=arcsin((d1-d3) / m1m3) (2)

[0091] Wherein, β is the vertical offset viewing angle; d3 and d1 are respectively the distances between the user's first preset point and the line connecting the endpoints m1 and m3 in the target viewing picture; and m1m3 is the distance between the line connecting the endpoints m1 and m3 of the target viewing picture.

[0092] When the user shifts to the left or right of the target viewing screen, and also shifts to the top or bottom of the target viewing screen, the user's horizontal offset viewing angle and vertical offset viewing angle are not 0°. d1, d2, d3 and d4 are not equal. The adjustment module 220 can calculate the horizontal offset viewing angle and the vertical offset viewing angle respectively through the above formula (1) and formula (2). For example, the adjustment module 220 determines that the user's horizontal offset viewing angle is negative 15° and the vertical offset viewing angle is negative 30° through formula (1) and formula (2).

[0093] In some embodiments, when the shape of the target viewing screen is not a rectangle or a square, but other shapes (such as a circle, an irregular polygon, etc.), the adjustment module 220 can first determine the four endpoints of the target viewing screen according to a preset rule, and then determine the size of the offset viewing angle. The preset rule can be a rule for how to determine the endpoints. For example, the preset rule is that two endpoints are two endpoints in the target viewing screen that intersect with the edge of the target viewing screen on a horizontal line relative to the user; the other two endpoints are two endpoints in the target viewing screen that intersect with the edge of the target viewing screen on a vertical line relative to the user; the connection line of the four endpoints can divide the target viewing screen into four parts with similar sizes. The adjustment module 220 can determine the four endpoints of the target viewing screen based on the above preset rules. The adjustment module 220 can determine the size of the offset viewing angle based on the determined four endpoints and the user's first preset point. For example, the adjustment module 220 determines the horizontal offset viewing angle and the vertical offset viewing angle through formula (1) and formula (2).

[0094] The deformation parameter may be relevant data about how the target viewing picture is deformed. In some embodiments, the deformation parameter is a parameter for deforming the content in the target viewing picture, and the deformation includes twisting and rotating. When the viewing angle of the user is the same as the standard viewing angle, the deformation parameter of the target viewing picture may be 0. When the user is at a viewing angle other than the standard viewing angle, the deformation parameter is not 0. The larger the offset angle between the viewing angle and the standard viewing angle, the larger the corresponding deformation parameter. The smaller the offset angle between the viewing angle and the standard viewing angle, the smaller the corresponding deformation parameter.

[0095] The target viewing picture is displayed to the user after being deformed based on the deformation parameters, and the target viewing picture viewed by the user is not deformed, which is equivalent to the target viewing picture viewed from a standard viewing angle.

[0096] In some embodiments, the adjustment module 220 can determine the deformation parameters of the target viewing picture in a variety of ways based on the viewing angle and the standard viewing angle. For example, the adjustment module 220 can build a database based on historical data and / or data obtained through the Internet. The database contains deformation parameters corresponding to different viewing angles of the user, scaling parameters corresponding to different viewing distances between the user and the display screen, etc. The adjustment module 220 can match the database based on the user's current viewing angle to determine the deformation parameters of the target viewing picture. For another example, a correspondence between the offset viewing angle and the deformation parameter can be constructed, and the deformation parameter can be determined based on the correspondence.

[0097] In some embodiments, the adjustment module 220 may process the viewing angle and the standard angle through a deformation parameter determination model to determine the deformation parameters.

[0098] The deformation parameter determination model may be a machine learning model. In some embodiments, the type of the deformation parameter determination model may include a neural network model, a deep neural network model, etc., and the selection of the model type may depend on the specific situation.

[0099] In some embodiments, the input of the deformation parameter determination model may include a viewing angle, a standard angle of view, etc. The output of the deformation parameter determination model may include deformation parameters.

[0100] In some embodiments, the deformation parameter determination model can be obtained based on multiple sets of first training samples and labels. The first training samples include multiple sets of training data and labels for each set of training data, each set of training data includes a sample viewing angle and a sample standard viewing angle. The label of each set of training data is a sample deformation parameter of a sample target viewing picture. The training samples can be obtained based on historical data.

[0101] In some embodiments, the first training sample can be determined by screening historical data. For example, historical data in which the user's actions meet the requirements when viewing the historical target viewing screen of the display screen are screened as the first training sample. For example, historical data in which the number of times the user's head moves is small is used as the first training sample. The user's head action can be determined by recognizing the image captured by the camera.

[0102] In some embodiments, the input of the deformation parameter determination model may be the first image and the second image. The output of the deformation parameter determination model may be the deformation parameters. For more information about the first image and the second image, see Figure 3 Related description.

[0103] In some embodiments, the deformation parameter determination model includes a first feature extraction layer, a second feature extraction layer, and a prediction layer. The first feature extraction layer inputs include the first image and the second image, and outputs a standard viewing angle feature vector. The second feature extraction layer inputs include the first image, and outputs a viewing angle feature vector. The prediction layer inputs include the standard viewing angle feature vector and the viewing angle feature vector, and outputs the deformation parameter. The first feature extraction layer and the second feature extraction layer can be CNN and other models. The prediction layer can be DNN and the like. At this time, each set of training data of the deformation parameter determination model is a sample first image and a sample second image.

[0104] In some embodiments of the present specification, the deformation parameters are determined by a deformation parameter determination model, which can improve the accuracy of the determined deformation parameters, thereby improving the accuracy of the deformation of the target viewing picture and improving the user experience.

[0105] Step 420: deform the target viewing picture based on the deformation parameters.

[0106] In some embodiments, the adjustment module 220 may deform the target viewing picture based on the deformation parameters.

[0107] Figure 6a FIG. 1 is an exemplary schematic diagram of not deforming a target viewing image based on deformation parameters according to some embodiments of this specification. Figure 6a As shown, the viewing angle between the user and the target viewing picture is the same as the standard viewing angle, the deformation parameter is 0, and the target viewing picture (such as picture 1, picture 2, picture 3, etc.) in the display screen 610 does not need to be deformed.

[0108] Figure 6b FIG. 1 is an exemplary schematic diagram of deforming a target viewing picture based on deformation parameters according to some embodiments of this specification. Figure 6b As shown, the viewing angle between the user and the target viewing picture is different from the standard viewing angle, and the user needs to look up to view the target viewing picture. The target viewing picture in the display screen 620 needs to be deformed to ensure that the target viewing picture viewed by the user is clear and not deformed, so as to achieve the effect of looking directly at the target viewing picture. Compared with the undeformed target viewing picture in the display screen 610, the shapes of the pictures 1, 2, and 3 of the deformed target viewing picture in the display screen 620 have changed.

[0109] Figure 6c FIG. 1 is another exemplary schematic diagram of deforming a target viewing picture based on deformation parameters according to some embodiments of this specification. Figure 6cAs shown, the viewing angle between the user and the target viewing picture is different from the standard viewing angle, and the user needs to look down to view the target viewing picture. The target viewing picture in the display screen 630 needs to be deformed. Compared with the undeformed target viewing picture in the display screen 610, the shapes of the pictures 1, 2, and 3 of the deformed target viewing picture in the display screen 630 are changed.

[0110] In some embodiments of the present specification, the target viewing picture is deformed based on deformation parameters to ensure that no matter how much the user's viewing angle deviates from the standard viewing angle, the user's viewing effect of the target viewing picture is equivalent to that of the user at the standard viewing angle, thereby improving the user's experience.

[0111] Figure 5 FIG. 1 is an exemplary flow chart of scaling a target viewing image based on a scaling parameter according to some embodiments of this specification. Figure 5 As shown, the process 500 includes the following steps. In some embodiments, the process 500 may be executed by the adjustment module 220 .

[0112] Step 510: Determine a scaling parameter of the target viewing picture based on the viewing distance.

[0113] The scaling parameter may refer to relevant data about how the target viewing picture is scaled. For example, the scaling parameter may be a real value (0.8, 1.2, 2, 3, etc.). The size of the value may represent the multiple of the scaling of the target viewing picture. For example, a scaling parameter of 0.8 means that the target viewing picture is reduced to 0.8 times the normal value. A scaling parameter of 2 means that the target viewing picture is enlarged to 2 times the normal value. A scaling parameter of 1 means that the target viewing picture is normal and does not need to be scaled.

[0114] In some embodiments, the adjustment module 220 may determine the zoom parameter of the target viewing picture based on the viewing distance between the user and the display screen. The zoom parameter is positively correlated with the viewing distance.

[0115] The scaling parameters may include reduction parameters, enlargement parameters, etc. The reduction parameters include reduction times, etc. The enlargement parameters include enlargement times, etc.

[0116] In some embodiments, the adjustment module 220 may determine a reduction parameter or an enlargement parameter based on the difference between the viewing distance and the preset distance. The reduction factor or the enlargement factor is positively correlated with the absolute value of the difference. For example, if the difference between the viewing distance and the preset distance is greater than 0, the deformation parameter is an enlargement parameter, and the greater the difference, the greater the enlargement factor. If the difference between the viewing distance and the preset distance is less than 0, the deformation parameter is a reduction parameter, and the greater the absolute value of the difference, the greater the reduction factor.

[0117] The preset distance may refer to an optimal viewing distance between the user and the display screen. When the distance between the user and the display screen is the preset distance, the target viewing picture does not need to be reduced or enlarged, and the reduction parameter or the enlargement parameter is 0.

[0118] In some embodiments, the adjustment module 220 may determine the scaling parameters of the target viewing picture based on a database. For details about the database, see the above.

[0119] In some embodiments of the present specification, the reduction parameter or enlargement parameter of the target viewing screen is determined based on the difference between the viewing distance and the preset distance, so as to ensure that no matter how far the distance between the user and the display screen is, when the user views the target viewing screen, the size of the target viewing screen is optimal, which is conducive to improving the user's usage experience.

[0120] In some embodiments, the adjustment module 220 may determine the scaling parameter by a scaling parameter determination model.

[0121] The scaling parameter determination model may be a machine learning model. In some embodiments, the type of the scaling parameter determination model may include a convolutional neural network model, etc., and the selection of the model type may depend on the specific situation.

[0122] In some embodiments, the input of the scaling parameter determination model may include the first image and the second image, etc. The output of the scaling parameter determination model may include the scaling parameter. For example, the scaling parameter determination model processes the first image and the second image, etc. to determine the scaling parameter of the target viewing picture. For more information about the first image and the second image, see Figure 3 Related description.

[0123] In some embodiments, the scaling parameter determination model may be obtained based on multiple sets of second training samples and label training.

[0124] In some embodiments, the second training sample includes multiple sets of training data and labels for each set of training data, each set of training data includes a sample first image and a sample second image. The label for each set of training data is a sample scaling parameter of the target viewing picture. The second training sample can be obtained based on historical data.

[0125] In some embodiments, the training sample can be determined by screening historical data. For example, historical data in which the user's actions meet the requirements when viewing the historical target viewing screen of the display screen are screened as training samples. For example, historical data in which the user's forward and backward movement has a small amplitude is used as a training sample. The forward and backward movement of the user can be determined by recognizing the image captured by the camera.

[0126] In some embodiments of the present specification, by determining the zoom parameter through a zoom parameter determination model, the accuracy of the determined zoom parameter can be improved, thereby improving the accuracy of zooming the target viewing picture and improving the user experience.

[0127] Step 520: scaling the target viewing picture based on the scaling parameter.

[0128] In some embodiments, the adjustment module 220 may scale the target viewing picture based on the scaling parameter. Figure 7b FIG. 1 is an exemplary schematic diagram of not scaling the target viewing picture based on the scaling parameters shown in some embodiments of this specification. Figure 7b As shown, the viewing distance between the user and the display screen 720 is optimal (eg, 2 meters), and the target viewing image in the display screen 720 does not need to be scaled.

[0129] Figure 7a FIG. 1 is an exemplary schematic diagram of reducing the target viewing picture based on the zoom parameter according to some embodiments of this specification. Figure 7a As shown, the viewing distance between the user and the display screen 710 is relatively close (e.g., 1 meter), and the target viewing picture needs to be reduced to ensure that the user sees the best target viewing picture. The reduced target viewing picture in the display screen 710 has a different size compared to the unscaled target viewing picture in the display screen 720. In the process of reducing the target viewing picture, the adjustment module 220 can add a new target viewing picture to the display screen. Figure 7a With Figure 7b Compared with the display screen 710, two target viewing screens are added.

[0130] Figure 7c FIG. 1 is an exemplary schematic diagram of enlarging a target viewing picture based on a zoom parameter according to some embodiments of this specification. Figure 7c As shown, the viewing distance between the user and the display screen 730 is far (e.g., 5 meters), and the target viewing picture needs to be enlarged to ensure that the target viewing picture viewed by the user is the best. The enlarged target viewing picture in the display screen 730 is changed in size compared to the unenlarged target viewing picture in the display screen 720. In the process of enlarging the target viewing picture, the adjustment module 220 can reduce the target viewing picture in the display screen. Figure 7c With Figure 7b In comparison, display screen 730 reduces two target viewing screens.

[0131] In some embodiments, when the user demand is a key demand, Figure 7a , Figure 7b and Figure 7cThe screen in the display may be a button and / or a menu, etc. The adjustment module 220 may enlarge or reduce the buttons and / or menus in the display according to the zoom parameter. For more information about user needs, see Figure 8 Related description.

[0132] In some embodiments of the present specification, the target viewing picture is scaled based on the viewing distance, which can ensure that the target viewing picture is of a moderate size regardless of the user's viewing distance, thereby improving the user's experience.

[0133] Figure 8 This is an exemplary schematic diagram of adjusting the main viewing content to the main display position according to some embodiments of this specification.

[0134] In some embodiments, the adjustment module 220 may determine the main viewing content from the target viewing picture.

[0135] The main viewing content may refer to the content in the display screen that the user is interested in. For example, when a movie and an advertisement are being played in the display screen, the user is more interested in the movie than in the advertisement, and the movie is the main viewing content.

[0136] In some embodiments, the main viewing content may be a preset specific content, for example, a movie is the main viewing content.

[0137] In some embodiments, the adjustment module 220 can determine the main viewing content by combining one or more factors of the current display content, historical playback records, remote control conditions, and user feedback. For example, the adjustment module 220 detects that the current display content of the display screen is a movie and an advertisement. The adjustment module 220 can determine the movie as the main viewing content. For another example, the adjustment module 220 can determine the main viewing content by the above-mentioned multiple factors (such as the current display content and the historical playback records). Different factors can correspond to different weights. The weights corresponding to different factors can be preset in advance. For example, the corresponding weights of the current display content and the historical playback records are 0.3 and 0.7, respectively. Exemplarily, the current display content is a movie and an advertisement. The user tends to watch movies rather than other content such as advertisements. The adjustment module 220 can determine that the user's attention to movies is 70 points, and the user's attention to other content such as advertisements is 30 points. By analyzing the user's historical playback records, it is determined that the number of times the user pays attention to movies accounts for 90%, and the number of times the user pays attention to other content such as advertisements accounts for 10%. The adjustment module 220 can determine that the user's attention to movies in the historical playback records is 90 points, and the user's attention to other content such as advertisements is 10 points. The weighted score of the user's attention to the movie is 84 points (70*0.3+90*0.7), and the weighted score of the user's attention to other content such as advertisements is 16 points (30*0.3+10*0.7). The adjustment module 220 can determine the movie as the main viewing content.

[0138] In some embodiments, the adjustment module 220 may obtain a first sequence and a second sequence of the user, and determine the main viewing content based on the first sequence and the second sequence.

[0139] The first sequence may include a sequence of historical control parameters of a remote control or keyboard at multiple time points. The historical control parameters may include the operation mode of the remote control by the user at different time points, etc. The multiple time points may be multiple time points before the current time point. For example, multiple time points within 10 minutes, 15 minutes, etc. before the current time point.

[0140] The second sequence may include a sequence of historical display contents of the display screen at multiple time points. The multiple time points of the second sequence may correspond one-to-one to the multiple time points of the first sequence. For example, at multiple time points within 10 minutes, 15 minutes, etc. before the current time point, the historical display contents of the display screen of the second sequence corresponding to the first time point, the second time point, the third time point, and the Nth time point of the first sequence are movies, variety shows, advertisements, TV series, etc. respectively.

[0141] In some embodiments, the adjustment module 220 may determine the main viewing content based on the first sequence and the second sequence. For example, if the display screen historical display content of the second sequence corresponding to the lack of operation at multiple time points in the first sequence is a variety show, the adjustment module may determine the variety show as the main viewing content.

[0142] By analyzing the historical control parameters of the remote controller at multiple time points and the historical display contents of the display screen at multiple time points to determine the main viewing content, the accuracy of the determined main viewing content can be further improved.

[0143] In some embodiments, the adjustment module 220 may process the first sequence and the second sequence through a content prediction model to determine the main viewing content.

[0144] The content prediction model may refer to a model used to predict the content that a user will watch. In some embodiments, the content prediction model may be a machine learning model. The types of content prediction models may include a long-short term memory model (LSTM), a recurrent neural network (RNN), etc. The choice of model type may depend on the specific situation.

[0145] In some embodiments, the input of the content prediction model may include a first sequence and a second sequence. The output of the content prediction model may include the content primarily viewed by the user. For example, the first sequence and the second sequence are processed based on the content prediction model to determine the content primarily viewed by the user (such as a movie, etc.).

[0146] In some embodiments, a content prediction model can be obtained based on multiple sets of third training samples and labels. The third training samples include multiple sets of training data and labels for each set of training data, each set of training data includes a first sequence of samples and a second sequence of samples. The label of each set of training data is the sample main viewing content of the user. The training samples can be obtained based on historical data.

[0147] In some embodiments, the input to the content prediction model also includes a third sequence.

[0148] The third sequence refers to a sequence of user actions at multiple time points. The user's actions may include looking up at the display screen, looking down at the display screen, playing with a mobile phone, exercising, etc. The third sequence can reflect the different needs of users corresponding to different time points. For example, when the user's action is looking up at the display screen, it means that the user has a viewing need at that time point, and the content the user is watching is located above the display screen. For another example, when the user's action is looking down at the display screen, it means that the user has a viewing need at that time point, and the content the user is watching is located below the display screen. For another example, when the user's action is playing with a mobile phone and exercising, it means that the user has no viewing need at that time point.

[0149] By processing the first sequence, the second sequence and / or the third sequence to determine the main viewing content through the content prediction model, the basis for determining the main viewing content can be enriched, and the efficiency and accuracy of determining the main viewing content can be further improved.

[0150] In some embodiments, the adjustment module 220 can determine the main display position of the display screen based on the position of the reference point. For more information about the position of the reference point, see Figure 3 and its related description.

[0151] The main display position may refer to the best viewing area for the user on the display screen. For example, the main display position may be the position or area on the display screen that is closest to the first preset point of the user. For another example, the main display position may be the position or area that forms the smallest viewing angle with the first preset point of the user. The adjustment module 220 may determine the main display position based on a variety of methods.

[0152] In some embodiments, the adjustment module 220 can determine the main display position based on the offset viewing angle. For example, the user's viewing angle is a horizontal offset viewing angle of negative 15° (the user offsets to the right of the target viewing screen) and a vertical offset viewing angle of negative 30° (the user's viewing angle is low and needs to look up to view the target viewing screen). The lower right corner area of ​​the display screen can be the main display position (the boundary of the main display position does not exceed the boundary of the display screen). For more information about determining the offset viewing angle, see Figure 4 and its related description.

[0153] In some embodiments, the adjustment module 220 may adjust the main viewing content to the main display position.

[0154] like Figure 8 As shown, the adjustment module 220 adjusts the main viewing content in the display screen 810 to the main display position in the display screen 820, and obtains the display screen 830. The main viewing content in the display screen 830 coincides with the main display position, and the user's viewing angle is optimal.

[0155] Based on the relative relationship between the user and the display screen, the main viewing content is adjusted to the main display position, which can ensure that the user can watch the content they want to watch in a comfortable posture, and avoid the visual impact of other content except the main viewing content on the user, thereby improving the user's viewing experience.

[0156] It should be noted that the above description of the relevant process is only for example and explanation, and does not limit the scope of application of this specification. For those skilled in the art, various modifications and changes can be made to the process under the guidance of this specification. However, these modifications and changes are still within the scope of this specification.

[0157] The basic concepts have been described above. Obviously, for those skilled in the art, the above detailed disclosure is only for example and does not constitute a limitation of this specification. Although not explicitly stated here, those skilled in the art may make various modifications, improvements and corrections to this specification. Such modifications, improvements and corrections are suggested in this specification, so such modifications, improvements and corrections still belong to the spirit and scope of the exemplary embodiments of this specification.

[0158] At the same time, this specification uses specific words to describe the embodiments of this specification. For example, "one embodiment", "an embodiment", and / or "some embodiments" refer to a certain feature, structure or characteristic related to at least one embodiment of this specification. Therefore, it should be emphasized and noted that "one embodiment" or "an embodiment" or "an alternative embodiment" mentioned twice or more in different positions in this specification does not necessarily refer to the same embodiment. In addition, certain features, structures or characteristics in one or more embodiments of this specification can be appropriately combined.

[0159] In addition, unless explicitly stated in the claims, the order of the processing elements and sequences described in this specification, the use of alphanumeric characters, or the use of other names are not intended to limit the order of the processes and methods of this specification. Although the above disclosure discusses some invention embodiments that are currently considered useful through various examples, it should be understood that such details are only for illustrative purposes, and the attached claims are not limited to the disclosed embodiments. On the contrary, the claims are intended to cover all modifications and equivalent combinations that are consistent with the essence and scope of the embodiments of this specification. For example, although the system components described above can be implemented by hardware devices, they can also be implemented only by software solutions, such as installing the described system on an existing server or mobile device.

[0160] Similarly, it should be noted that in order to simplify the description disclosed in this specification and thus help understand one or more embodiments of the invention, in the above description of the embodiments of this specification, multiple features are sometimes combined into one embodiment, figure or description thereof. However, this disclosure method does not mean that the features required by the subject matter of this specification are more than the features mentioned in the claims. In fact, the features of the embodiments are less than all the features of the single embodiment disclosed above.

[0161] In some embodiments, numbers describing the number of components and attributes are used. It should be understood that such numbers used in the description of the embodiments are modified by the modifiers "about", "approximately" or "substantially" in some examples. Unless otherwise specified, "about", "approximately" or "substantially" indicate that the numbers are allowed to vary by ±20%. Accordingly, in some embodiments, the numerical parameters used in the specification and claims are approximate values, which may change according to the required features of individual embodiments. In some embodiments, the numerical parameters should take into account the specified significant digits and adopt the general method of retaining digits. Although the numerical domains and parameters used to confirm the breadth of their range in some embodiments of this specification are approximate values, in specific embodiments, the setting of such numerical values ​​is as accurate as possible within the feasible range.

[0162] Each patent, patent application, patent application publication, and other materials, such as articles, books, specifications, publications, documents, etc., cited in this specification are hereby incorporated by reference in their entirety. Except for application history documents that are inconsistent with or conflicting with the contents of this specification, documents that limit the broadest scope of the claims of this specification (currently or later attached to this specification) are also excluded. It should be noted that if the descriptions, definitions, and / or use of terms in the materials attached to this specification are inconsistent or conflicting with the contents described in this specification, the descriptions, definitions, and / or use of terms in this specification shall prevail.

[0163] Finally, it should be understood that the embodiments described in this specification are only used to illustrate the principles of the embodiments of this specification. Other variations may also fall within the scope of this specification. Therefore, as an example and not a limitation, alternative configurations of the embodiments of this specification may be considered consistent with the teachings of this specification. Accordingly, the embodiments of this specification are not limited to the embodiments explicitly introduced and described in this specification.

Claims

1. A method for adjusting display content, characterized in that: The method comprises: Determining a relative relationship between a user and a display screen, wherein the relative relationship includes at least one of a viewing distance between the user and the display screen, a position of a reference point on the display screen that satisfies a preset condition from a first preset point of the user, and a viewing angle of the user when viewing a target viewing picture on the display screen; Based on the relative relationship, adjusting the target viewing picture includes: Determining a main viewing content from the target viewing picture, where the main viewing content is the content that the user is interested in on the display screen; including: Acquire a first sequence, a second sequence, and a third sequence of the user, wherein the first sequence includes a sequence of historical control parameters of the remote controller at multiple time points, the second sequence includes a sequence of historical display contents of the display screen at multiple time points, and the third sequence refers to a sequence of user actions at multiple time points, wherein the user actions include looking up at the display screen, looking down at the display screen, playing with a mobile phone, and exercising; Based on the first sequence, the second sequence and the third sequence, the main viewing content is determined by a content prediction model, wherein the content prediction model is a machine learning model; based on the position of the reference point, a main display position of the display screen is determined, wherein the main display position is an optimal viewing area of ​​the user on the display screen; Adjusting the main viewing content to the main display position; Based on the first image and the second image, the deformation parameters of the target viewing picture are determined by a deformation parameter determination model, wherein the first image refers to an image of the user taken by a camera on the display screen, and the second image refers to an image taken by a global camera in the space where the display screen is located and used to take pictures of the display screen and the user, and the deformation parameter determination model includes a first feature extraction layer, a second feature extraction layer and a prediction layer, including: Based on the first image and the second image, through the first feature extraction layer, Determine a standard viewing angle feature vector; Based on the first image, determining a viewing angle feature vector through the second feature extraction layer, wherein the first feature extraction layer and the second feature extraction layer are convolutional neural networks; Based on the standard viewing angle feature vector and the viewing angle feature vector, the deformation parameter is determined through the prediction layer, and the prediction layer is a deep neural network; based on the deformation parameter, the target viewing picture is deformed.

2. The method according to claim 1, characterized in that The adjusting the target viewing picture in the display screen based on the relative relationship includes: Determining deformation parameters of the target viewing picture based on the viewing angle and the standard viewing angle; The target viewing picture is deformed based on the deformation parameters.

3. The method according to claim 1, characterized in that: The adjusting the target viewing picture based on the relative relationship includes: Based on the viewing distance, determining a scaling parameter of the target viewing picture; The target viewing picture is scaled based on the scaling parameter.

4. A display content adjustment system, characterized in that: The system comprises: a determination module, configured to determine a relative relationship between a user and a display screen, wherein the relative relationship includes at least one of a viewing distance between the user and the display screen, a position of a reference point on the display screen that satisfies a preset condition from a first preset point of the user, and a viewing angle of the user when viewing a target viewing picture on the display screen; An adjustment module is used to adjust the target viewing picture based on the relative relationship, including: Determining a main viewing content from the target viewing picture, where the main viewing content is the content that the user is interested in on the display screen; including: Acquire a first sequence, a second sequence, and a third sequence of the user, wherein the first sequence includes a sequence of historical control parameters of the remote controller at multiple time points, the second sequence includes a sequence of historical display contents of the display screen at multiple time points, and the third sequence refers to a sequence of user actions at multiple time points, wherein the user actions include looking up at the display screen, looking down at the display screen, playing with a mobile phone, and exercising; Based on the first sequence, the second sequence and the third sequence, determining the main viewing content through a content prediction model, wherein the content prediction model is a machine learning model; Determine a main display position of the display screen based on the position of the reference point, wherein the main display position is an optimal viewing area of ​​the user on the display screen; Adjusting the main viewing content to the main display position; Based on the first image and the second image, the deformation parameters of the target viewing picture are determined by a deformation parameter determination model, wherein the first image refers to an image of the user taken by a camera on the display screen, and the second image refers to an image taken by a global camera in the space where the display screen is located and used to take pictures of the display screen and the user, and the deformation parameter determination model includes a first feature extraction layer, a second feature extraction layer and a prediction layer, including: Based on the first image and the second image, determining a standard viewing angle feature vector through the first feature extraction layer; Based on the first image, determining a viewing angle feature vector through the second feature extraction layer, wherein the first feature extraction layer and the second feature extraction layer are convolutional neural networks; Based on the standard viewing angle feature vector and the viewing viewing angle feature vector, determining the deformation parameter through the prediction layer, wherein the prediction layer is a deep neural network; The target viewing picture is deformed based on the deformation parameters.

5. The system according to claim 4, characterized in that The adjustment module is further used to: determine the deformation parameters of the target viewing picture based on the viewing angle and the standard viewing angle; The target viewing picture is deformed based on the deformation parameters.

6. The system according to claim 4, characterized in that The adjustment module is further used for: Based on the viewing distance, determining a scaling parameter of the target viewing picture; The target viewing picture is scaled based on the scaling parameter.

7. A display content adjustment device, characterized in that: The apparatus comprises at least one processor and at least one memory; The at least one memory is used to store computer instructions; The at least one processor is configured to execute at least part of the computer instructions to implement the method according to any one of claims 1 to 3.

8. A computer-readable storage medium, characterized in that: The storage medium stores computer instructions, which implement the method according to any one of claims 1 to 3 when executed by a processor.

Images