Method and device for determining viewing position of user relative to naked-eye 3D display device

By using multiple sets of image acquisition modules on naked-eye 3D display devices to determine user facial information and offsets, the problem of limited human eye tracking range in the prior art is solved, and a larger range of human eye tracking is achieved and more flexible human eye tracking is achieved. The location selection improves the 3D experience.

CN114449250BActive Publication Date: 2024-11-22Z2D VISION TECH (NANJING) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210114132.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-01-30
Publication Date
2024-11-22
Estimated Expiration
2042-01-30

AI Technical Summary

Technical Problem

The existing naked-eye 3D display devices have limited human eye tracking range, which causes users to be unable to determine their location when they exceed the tracking range, affecting the 3D experience, especially when the location information is reduced when it is near the edge of the tracking range.

Method used

At least two sets of image acquisition modules are used to determine user face information from candidate monitoring images, calculate offsets in each group of target monitoring images, and determine the user's viewing position relative to the screen based on these offsets to achieve a larger range. human eye tracking.

Benefits of technology

Through a larger range of human eye tracking and more flexible location selection, the user's 3D experience is improved and the accuracy and consistency of 3D display content in different locations is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114449250B_ABST
    Figure CN114449250B_ABST
Patent Text Reader

Abstract

The embodiment of the present invention discloses a method and device for determining the viewing position of a user relative to a naked-eye 3D display device. The method comprises: determining at least one group of target monitoring images including user facial information from at least two groups of candidate monitoring images; each group of candidate monitoring images is acquired by a group of image acquisition modules arranged on the naked-eye 3D display device, and the number of image acquisition modules is at least two groups; determining the offset of the user in each group of target monitoring images; and determining the viewing position of the user relative to the screen according to the offset of the user in each group of target monitoring images. By executing the technical solution provided by the embodiment of the present invention, a wider range of human eye tracking can be achieved, more flexible position selection can be provided to the user, and the user's 3D experience can be enhanced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present invention relate to the technical field of naked-eye 3D display, and in particular to a method and device for determining a viewing position of a user relative to a naked-eye 3D display device. Background Art

[0002] In order to improve the problem of limited viewing position of naked-eye 3D displays, the prior art proposes a solution of eye tracking to determine the viewer's position relative to the naked-eye 3D display in real time, and adjust the displayed content or the relative position of the spectroscopic element so that the viewer can always see the ideal 3D content.

[0003] However, the tracking range determined by the human eye tracking method in the related art is limited. When the user is outside the tracking range, the user's position cannot be determined, and thus the ideal 3D display content cannot be presented to the user. In addition, when the user is near the edge of the tracking range, the accuracy of the determined position information will also decrease, thereby greatly reducing the user's 3D experience. Summary of the invention

[0004] The embodiments of the present invention provide a method and apparatus for determining a user's viewing position relative to a naked-eye 3D display device, which can achieve human eye tracking in a wider range, provide users with more flexible position selection, and enhance the user's 3D experience.

[0005] In a first aspect, an embodiment of the present invention provides a method for determining a viewing position of a user relative to a naked-eye 3D display device, characterized by comprising:

[0006] Determine at least one group of target monitoring images including user facial information from at least two groups of candidate monitoring images; wherein each group of candidate monitoring images is acquired by a group of image acquisition modules disposed on the naked-eye 3D display device, and the number of the image acquisition modules is at least two groups;

[0007] Determine the offset of the user in each group of target surveillance images;

[0008] The viewing position of the user relative to the screen is determined based on the offset of the user in each set of target monitoring images.

[0009] In a second aspect, an embodiment of the present invention further provides a device for determining a viewing position of a user relative to a naked-eye 3D display device, characterized in that it includes:

[0010] A target monitoring image determination unit, configured to determine at least one group of target monitoring images including user facial information from at least two groups of candidate monitoring images; wherein each group of candidate monitoring images is acquired by a group of image acquisition modules provided on the naked-eye 3D display device, and the number of the image acquisition modules is at least two groups;

[0011] A user offset determination module, used to determine the offset of the user in each group of target monitoring images;

[0012] The viewing position determination module is used to determine the viewing position of the user relative to the screen according to the offset of the user in each group of target monitoring images.

[0013] In a third aspect, an embodiment of the present invention further provides an electronic device, the device comprising:

[0014] one or more processors;

[0015] a storage device for storing one or more programs,

[0016] When the one or more programs are executed by the one or more processors, the one or more processors implement the method for determining the viewing position of a user relative to a naked-eye 3D display device as described in any one of the embodiments of the present invention.

[0017] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements a method for determining a user's viewing position relative to a naked-eye 3D display device as described in any one of the embodiments of the present invention.

[0018] The technical solution provided by the embodiment of the present invention determines at least one group of target monitoring images including user facial information from at least two groups of candidate monitoring images; wherein each group of candidate monitoring images is acquired by a group of image acquisition modules arranged on a naked-eye 3D display device, and the number of image acquisition modules is at least two groups; the offset of the user in each group of target monitoring images is determined; and the viewing position of the user relative to the screen is determined according to the offset of the user in each group of target monitoring images. By executing the technical solution provided by the embodiment of the present invention, a wider range of human eye tracking can be achieved, more flexible position selection can be provided to the user, and the user's 3D experience can be enhanced. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 is a flow chart of a method for determining a viewing position of a user relative to a naked-eye 3D display device provided by an embodiment of the present invention;

[0020] Figure 2 is a flowchart of another method for determining a viewing position of a user relative to a naked-eye 3D display device provided by an embodiment of the present invention;

[0021] Figure 3 is a schematic diagram of a user at position 1 provided by an embodiment of the present invention;

[0022] Figure 4(a) is a second view determined by the image acquisition module 1 when the user is at position 1 provided in an embodiment of the present invention;

[0023] Figure 4 (b) is a first view determined by the image acquisition module 1 when the user is at position 1 provided in an embodiment of the present invention;

[0024] Figure 5 is a schematic diagram of a user at position 2 provided by an embodiment of the present invention;

[0025] Figure 6 (a) is a second view determined by the image acquisition module 1 when the user is at position 2 provided in an embodiment of the present invention;

[0026] Figure 6 (b) is a first view determined by the image acquisition module 1 when the user is at position 2 provided by an embodiment of the present invention;

[0027] Figure 7 (a) is a second view determined by the image acquisition module 2 when the user is at position 2 provided by an embodiment of the present invention;

[0028] Figure 7 (b) is a first view determined by the image acquisition module 2 when the user is at position 2 provided in an embodiment of the present invention;

[0029] Figure 8 is a schematic diagram of a user at position 3 provided by an embodiment of the present invention;

[0030] Fig. 9 is a schematic structural diagram of a device for determining a viewing position of a user relative to a naked-eye 3D display device provided by an embodiment of the present invention;

[0031] Fig.10 It is a schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0032] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only parts related to the present invention, rather than all structures, are shown in the accompanying drawings.

[0033] Figure 1This is a flowchart of a method for determining a user's viewing position relative to a naked-eye 3D display device provided by an embodiment of the present invention. The method can be executed by a device for determining a user's viewing position relative to a naked-eye 3D display device. The device can be implemented in software and / or hardware. The device can be configured in an electronic device for determining a user's viewing position relative to a naked-eye 3D display device. The method is applied to a scenario in which a user views a 3D image through a naked-eye 3D display device. Figure 1 As shown, the technical solution provided by the embodiment of the present invention specifically includes:

[0034] S110: Determine at least one group of target monitoring images including user facial information from at least two groups of candidate monitoring images.

[0035] Each group of candidate monitoring images is acquired by a group of image acquisition modules arranged on the naked-eye 3D display device, and the number of the image acquisition modules is at least two.

[0036] Specifically, the naked eye 3D display device can be a display device that can be directly viewed with naked eyes without wearing 3D glasses to achieve a 3D effect, and the naked eye 3D display device can be a naked eye 3D display. The number of image acquisition modules should be set to at least two groups, each image acquisition module can be arranged in a straight line shape on the naked eye 3D display device, each image acquisition module can also be arranged in a broken line shape on the naked eye 3D display device, each image acquisition module can also be arranged in an arc shape on the naked eye 3D display device, and the arrangement form between each image acquisition module can be set according to actual needs. The image acquisition module may include two image acquisition devices, the image acquisition module may include three image acquisition devices, and the number of image acquisition devices in the image acquisition module can be set according to actual needs. Each image acquisition device in the image acquisition module outputs the captured candidate monitoring image through the same interface. The image acquisition device can be any type of sensor that can acquire user facial information, such as a single camera or multiple cameras.

[0037] The candidate monitoring image may be an eye tracking monitoring image, or a face tracking monitoring image, or a head tracking monitoring image. The candidate monitoring image may be set according to actual needs. The target monitoring image may be a view including the complete facial information of the user in the candidate monitoring image. The present solution may determine at least one group of target monitoring images including the facial information of the user from at least two groups of candidate monitoring images. If there is only one target monitoring image in a group of candidate monitoring images, the viewing position of the user relative to the screen cannot be determined based on the target monitoring image.

[0038] S120: Determine the offset of the user in each group of target monitoring images.

[0039] Exemplarily, for each view in each group of target surveillance images, the present solution can respectively determine the offset of the user in each view of the group of target surveillance images, and then use the absolute value of the average value of the offset of the user in each view of the group of target surveillance images as the offset of the user in the group of target surveillance images.

[0040] For each view, this solution can use the coordinates of the center point of the view as the coordinate origin, and then use the horizontal coordinates of the user's face center in the view relative to the coordinate origin as the offset of the user in the view. The horizontal coordinates of the areas on both sides of the center point of the view have opposite positive and negative signs.

[0041] S130: Determine the viewing position of the user relative to the screen according to the offset of the user in each group of target monitoring images.

[0042] Among them, this scheme can determine the viewing position of the user relative to the screen according to the offset of the user in each group of target monitoring images. For example, this scheme can determine the offset with the smallest value from the offset of the user in each group of target monitoring images, and determine the viewing position of the user relative to the screen according to the offset. For another example, this scheme can also calculate the first candidate viewing positions determined by the user based on each group of target monitoring images according to the offset of the user in each group of target monitoring images, use the offset of the user in each group of target monitoring images as a weight, and perform weighted average calculation on each first candidate viewing position to obtain the first actual viewing position of the user relative to the screen. For another example, this scheme can also determine a candidate offset less than a preset offset from the offset of the user in each group of target monitoring images, determine the second candidate viewing position of the user relative to the screen according to each candidate offset, and use the average value of each second candidate viewing position as the second actual viewing position of the user relative to the screen. According to the offset of the user in each group of target monitoring images, the strategy for determining the viewing position of the user relative to the screen can be set according to actual needs.

[0043] After determining the viewing position of the user relative to the screen, the present solution can also present an ideal naked-eye 3D display image to the user according to the viewing position of the user relative to the screen. For example, by moving the relative position between the 3D light splitting device in the naked-eye 3D display device and the display screen, or by moving the content displayed on the display screen, the user is provided with ideal 3D display content.

[0044] The technical solution provided by the embodiment of the present invention determines at least one group of target monitoring images including user facial information from at least two groups of candidate monitoring images; wherein each group of candidate monitoring images is acquired by a group of image acquisition modules arranged on a naked-eye 3D display device, and the number of image acquisition modules is at least two groups; the offset of the user in each group of target monitoring images is determined; and the viewing position of the user relative to the screen is determined according to the offset of the user in each group of target monitoring images. By executing the technical solution provided by the embodiment of the present invention, a wider range of human eye tracking can be achieved, more flexible position selection can be provided to the user, and the user's 3D experience can be enhanced.

[0045] Figure 2 1 is a flow chart of a method for determining a viewing position of a user relative to a naked-eye 3D display device provided by an embodiment of the present invention. This embodiment is optimized on the basis of the above embodiment. The above embodiment may be referred to for the similarities, and this embodiment is omitted here. Figure 2 As shown, the method for determining the viewing position of a user relative to the naked-eye 3D display device in the embodiment of the present invention may include:

[0046] S210: Determine at least one group of target surveillance images including user facial information from at least two groups of candidate surveillance images.

[0047] Each group of target monitoring images includes a first view and a second view.

[0048] For example, Figure 3 , Figure 4 As shown in (a)-4(b), when the user is at position 1, only the set of target monitoring images determined by image acquisition module 1 includes two views, view 11 and view 12. The set of candidate monitoring images determined by image acquisition module 2 does not include the user's facial information, and the set of candidate monitoring images determined by image acquisition module 3 does not include the user's facial information either.

[0049] like Figure 5 , Figure 6 As shown in (a)-6(b), when the user moves from position 1 to position 2, a set of target monitoring images determined by the image acquisition module 1 includes two views, view 11 and view 12. Figure 7 As shown in (a)-7(b), a set of target monitoring images determined by the image acquisition module 2 includes two views, view 21 and view 22. A set of candidate monitoring images determined by the image acquisition module 3 does not include the user's facial information.

[0050] S220: Determine a first offset of a user in any group of target surveillance images according to a first view in the first view; and determine a second offset of a user in the second view according to a second view in the group of target surveillance images.

[0051] Among them, for any two views in a group of target surveillance images, this scheme can determine the first offset of the user in the first view according to the first view, and determine the second offset of the user in the second view according to the second view, and then determine the offset of the user in the group of target surveillance images according to the first offset and the second offset.

[0052] In this embodiment, optionally, a first offset of a user in the first view is determined according to a first view in any group of target surveillance images; and a second offset of a user in the second view is determined according to a second view in the group of target surveillance images, including: taking the coordinates of a facial center of the user in the first view relative to a center point of the first view as the first offset of the user in the first view; and taking the coordinates of a facial center of the user in the second view relative to a center point of the second view as the second offset of the user in the second view.

[0053] The first view may be a left view in the group of target monitoring images, or a right view in the group of target monitoring images. The second view may be a left view in the group of target monitoring images, or a right view in the group of target monitoring images. Figure 6 As shown in (a)-6(b), taking a group of target monitoring images determined by the image acquisition module 1 as an example, the coordinates of the center point of view 11 are taken as the coordinate origin, and the horizontal coordinates of the user's face center in view 11 relative to the center point of view 11 are taken as the first offset x1L of the user in view 11. The coordinates of the center point of view 12 are taken as the coordinate origin, and the horizontal coordinates of the user's face center in view 12 relative to the center point of view 12 are taken as the second offset x1R of the user in view 12. Among them, the positive and negative signs of the horizontal coordinates of the areas on both sides of the view center are opposite, and the positive and negative values ​​of the first offset and the second offset are determined according to the side where the user's face center is relative to the coordinate origin.

[0054] For example, Figure 7 As shown in (a)-7(b), taking a group of target monitoring images determined by the image acquisition module 2 as an example, the coordinates of the center point of view 21 are taken as the coordinate origin, and the horizontal coordinates of the user's face center in view 21 relative to the center point of view 21 are taken as the first offset x2L of the user in view 21. The coordinates of the center point of view 22 are taken as the coordinate origin, and the horizontal coordinates of the user's face center in view 22 relative to the center point of view 22 are taken as the second offset x2R of the user in view 22.

[0055] Thus, by using the coordinates of the user's face center in the first view relative to the center point of the first view as the first offset of the user in the first view, and using the coordinates of the user's face center in the second view relative to the center point of the second view as the second offset of the user in the second view, a reliable data source can be provided for determining the offset of the user in the group of target monitoring images, thereby improving the accuracy of determining the viewing position of the user relative to the screen.

[0056] S230: Determine an offset of the user in the group of target monitoring images according to the first offset and the second offset.

[0057] In this solution, the absolute value of the average value of the first offset and the second offset can be used as the offset of the user in the group of target monitoring images.

[0058] In this embodiment, optionally, determining the offset of the user in the group of target surveillance images according to the first offset and the second offset includes: determining the absolute value of the average value of the first offset and the second offset as the offset of the user in the group of target surveillance images.

[0059] Among them, Figure 6 As shown in (a)-6(b), taking a group of target monitoring images determined by the image acquisition module 1 as an example, the offset DC1 of the user in the group of target monitoring images can be obtained by the formula to confirm.

[0060] For example, Figure 7 As shown in (a)-7(b), taking a group of target monitoring images determined by the image acquisition module 2 as an example, the offset DC2 of the user in the group of target monitoring images can be calculated by the formula to confirm.

[0061] Thus, by determining the absolute value of the average of the first offset and the second offset as the offset of the user in the group of target monitoring images, the problem of large error caused by considering only a single offset can be avoided, and the offset of the user in each group of target monitoring images can be determined more accurately, thereby providing a reliable data source for determining the viewing position of the user relative to the screen.

[0062] S240: Determine the viewing position of the user relative to the screen according to the offset of the user in each group of target monitoring images.

[0063] In this embodiment, optionally, the viewing position of the user relative to the screen is determined based on the offset of the user in each group of target monitoring images, including: determining a target offset with the smallest value from the offsets of the users in each group of target monitoring images; and determining the viewing position of the user relative to the screen based on the target offset.

[0064] When there are multiple target monitoring image groups, this solution can determine the user's offset in each group of target monitoring images, and then determine the offset with the smallest value from the determined offsets, that is, the target offset, and then determine the user's viewing position relative to the screen according to the target offset. The processing process of determining the user's viewing position relative to the screen according to the offset can refer to the relevant technology.

[0065] Thus, by determining the target offset with the smallest value from the offsets of the users in each group of target monitoring images and determining the viewing position of the user relative to the screen according to the target offset, it is possible to determine the spatial position of the user relative to the screen according to the offsets of multiple users.

[0066] In a feasible implementation, optionally, the viewing position of the user relative to the screen is determined based on the offset of the user in each group of target monitoring images, including: calculating each first candidate viewing position determined by the user based on each group of target monitoring images based on the offset of the user in each group of target monitoring images; using the offset of the user in each group of target monitoring images as a weight, performing a weighted average calculation on each of the first candidate viewing positions, and obtaining the first actual viewing position of the user relative to the screen.

[0067] Among them, Figure 5 , Figure 6 (a)-6(b) and Figure 7 As shown in (a)-7(b), the user's first candidate viewing position P1 relative to the screen can be determined based on the user's offset DC1 in a set of target monitoring images determined by the image acquisition module 1, and the user's first candidate viewing position P2 relative to the screen can be determined based on the user's offset DC2 in a set of target monitoring images determined by the image acquisition module 2. This solution can use the formula (P1×DC1+P2×DC2) / (DC1+DC2) to take the user's offset in each set of target monitoring images as a weight, perform a weighted average calculation on each first candidate viewing position, and obtain the user's first actual viewing position relative to the screen.

[0068] Thus, the first candidate viewing positions determined by the user based on each group of target monitoring images are calculated according to the user's offset in each group of target monitoring images; the user's offset in each group of target monitoring images is used as a weight to perform a weighted average calculation on each first candidate viewing position to obtain the first actual viewing position of the user relative to the screen. It is possible to determine the spatial position of the user relative to the screen according to the offsets of multiple users, and to obtain a more accurate spatial position of the user relative to the screen.

[0069] In another optional embodiment, optionally, the viewing position of the user relative to the screen is determined based on the offset of the user in each group of target monitoring images, including: determining a candidate offset that is less than a preset offset from the offset of the user in each group of target monitoring images; determining a second candidate viewing position of the user relative to the screen based on each candidate offset; and taking an average value of each of the second candidate viewing positions as the second actual viewing position of the user relative to the screen.

[0070] The preset offset may be 10 cm, the preset offset may be 15 cm, and the preset offset may be set according to actual needs. Figure 8 As shown, when the user is in position 3, the user's offset DC1 in a set of target monitoring images determined by image acquisition module 1 is 8 cm, the user's offset DC2 in a set of target monitoring images determined by image acquisition module 2 is 12 cm, and the user's offset DC3 in a set of target monitoring images determined by image acquisition module 3 is 9 cm. Assuming that the preset offset is 10 cm, DC1 and DC3 are less than the preset offset, and DC1 and DC3 are determined as candidate offsets. Then the second candidate viewing position of the user relative to the screen determined by DC1 is P1, and the second candidate viewing position of the user relative to the screen determined by DC3 is P3, and the average value of P1 and P3 is determined as the second actual viewing position of the user relative to the screen.

[0071] Thus, by determining a candidate offset less than a preset offset from the offsets of the users in each group of target monitoring images; determining a second candidate viewing position of the user relative to the screen according to each candidate offset; and taking the average of the second candidate viewing positions as the second actual viewing position of the user relative to the screen, it is possible to determine the spatial position of the user relative to the screen according to the offsets of multiple users, and to obtain a more accurate spatial position of the user relative to the screen.

[0072] The technical solution provided by the embodiment of the present invention determines at least one group of target monitoring images including user facial information from at least two groups of candidate monitoring images; determines the first offset of the user in the first view according to the first view in any group of target monitoring images; and determines the second offset of the user in the second view according to the second view in the group of target monitoring images; determines the offset of the user in the group of target monitoring images according to the first offset and the second offset; determines the viewing position of the user relative to the screen according to the offset of the user in each group of target monitoring images. By executing the technical solution provided by the embodiment of the present invention, a wider range of human eye tracking can be achieved, more flexible position selection can be provided to the user, and the user's 3D experience can be improved.

[0073] Fig. 9The present invention provides a schematic diagram of a structure of a device for determining a viewing position of a user relative to a naked-eye 3D display device provided in an embodiment of the present invention. The device can be configured in an electronic device for determining a viewing position of a user relative to a naked-eye 3D display device. Fig. 9 As shown, the device comprises:

[0074] The target monitoring image determination module 310 is used to determine at least one group of target monitoring images including the user's facial information from at least two groups of candidate monitoring images; wherein each group of candidate monitoring images is acquired by a group of image acquisition modules provided on the naked-eye 3D display device, and the number of the image acquisition modules is at least two groups;

[0075] A user offset determination module 320, used to determine the offset of the user in each group of target monitoring images;

[0076] The viewing position determination module 330 is used to determine the viewing position of the user relative to the screen according to the offset of the user in each group of target monitoring images.

[0077] Optionally, each group of target monitoring images includes a first view and a second view; accordingly, the user offset determination module 320 includes a view offset determination unit, which is used to determine a first offset of a user in the first view according to a first view in any group of target monitoring images; and determine a second offset of a user in the second view according to a second view in the group of target monitoring images; and a user offset determination unit, which is used to determine an offset of a user in the group of target monitoring images according to the first offset and the second offset.

[0078] Optionally, the view offset determination unit is specifically used to use the coordinates of the user's facial center in the first view relative to the center point of the first view as the first offset of the user in the first view; and to use the coordinates of the user's facial center in the second view relative to the center point of the second view as the second offset of the user in the second view.

[0079] Optionally, the user offset determination unit is specifically configured to determine an absolute value of an average value of the first offset and the second offset as an offset of the user in the group of target monitoring images.

[0080] Optionally, the viewing position determination module 330 includes a target offset determination unit, which is used to determine the target offset with the smallest value from the user's offsets in each group of target monitoring images; and a viewing position determination unit, which is used to determine the user's viewing position relative to the screen according to the target offset.

[0081] Optionally, the viewing position determination module 330 includes a first candidate viewing position determination unit, which is used to calculate each first candidate viewing position determined by the user based on each group of target monitoring images according to the user's offset in each group of target monitoring images; and a first actual viewing position determination unit, which is used to use the user's offset in each group of target monitoring images as a weight, and perform weighted average calculation on each of the first candidate viewing positions to obtain the user's first actual viewing position relative to the screen.

[0082] Optionally, the viewing position determination module 330 includes a candidate offset determination unit, which is used to determine a candidate offset that is less than a preset offset from the offset of the user in each group of target monitoring images; a second candidate viewing position determination unit, which is used to determine a second candidate viewing position of the user relative to the screen based on each candidate offset; and a second actual viewing position determination unit, which is used to take an average value of each of the second candidate viewing positions as the second actual viewing position of the user relative to the screen.

[0083] The device provided in the above embodiment can execute the method for determining the viewing position of a user relative to the naked-eye 3D display device provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0084] Fig.10 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present invention, such as Fig.10 As shown, the device includes:

[0085] one or more processors 410, Fig.10 A processor 410 is taken as an example;

[0086] Memory 420;

[0087] The device may further include: an input device 430 and an output device 440 .

[0088] The processor 410, memory 420, input device 430 and output device 440 in the device may be connected via a bus or other means. Fig.10 The example of connecting through bus is taken in the following.

[0089] The memory 420, as a non-transitory computer-readable storage medium, can be used to store software programs, computer executable programs and modules, such as program instructions / modules corresponding to a method for determining a viewing position of a user relative to a naked-eye 3D display device in an embodiment of the present invention. The processor 410 executes various functional applications and data processing of the computer device by running the software programs, instructions and modules stored in the memory 420, that is, to implement a method for determining a viewing position of a user relative to a naked-eye 3D display device in the above method embodiment, namely:

[0090] Determine at least one group of target monitoring images including user facial information from at least two groups of candidate monitoring images; wherein each group of candidate monitoring images is acquired by a group of image acquisition modules disposed on the naked-eye 3D display device, and the number of the image acquisition modules is at least two groups;

[0091] Determine the offset of the user in each group of target surveillance images;

[0092] The viewing position of the user relative to the screen is determined based on the offset of the user in each set of target monitoring images.

[0093] The memory 420 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 420 may include a high-speed random access memory, and may also include a non-transitory memory, such as at least one disk storage device, a flash memory device, or other non-transitory solid-state storage device. In some embodiments, the memory 420 may optionally include a memory remotely arranged relative to the processor 410, and these remote memories may be connected to the terminal device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0094] The input device 430 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the computer device. The output device 440 may include a display device such as a display screen.

[0095] An embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon. When the program is executed by a processor, a method for determining a viewing position of a user relative to a naked-eye 3D display device provided in an embodiment of the present invention is implemented, that is,

[0096] Determine at least one group of target monitoring images including user facial information from at least two groups of candidate monitoring images; wherein each group of candidate monitoring images is acquired by a group of image acquisition modules disposed on the naked-eye 3D display device, and the number of the image acquisition modules is at least two groups;

[0097] Determine the offset of the user in each group of target surveillance images;

[0098] The viewing position of the user relative to the screen is determined based on the offset of the user in each set of target monitoring images.

[0099] Any combination of one or more computer-readable media may be used. A computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in conjunction with an instruction execution system, device, or device.

[0100] Computer-readable signal media may include a data signal propagated in baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0101] Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0102] Computer program code for performing the operations of the present invention may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0103] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A method for determining a viewing position of a user relative to a naked-eye 3D display device, characterized in that: include: Determine at least one group of target monitoring images including user facial information from at least two groups of candidate monitoring images; wherein each group of candidate monitoring images is acquired by a group of image acquisition modules disposed on the naked-eye 3D display device, and the number of the image acquisition modules is at least two groups; Each set of target monitoring images includes a first view and a second view; Determine the offset of the user in each group of target surveillance images, including: Determining a first offset of a user in the first view according to a first view in any group of target surveillance images; and determining a second offset of a user in the second view according to a second view in the group of target surveillance images, comprising: Taking the coordinates of the center of the user's face in the first view relative to the center point of the first view as a first offset of the user in the first view; and, taking the coordinates of the center of the user's face in the second view relative to the center point of the second view as a second offset of the user in the second view; Determine an offset of the user in the group of target monitoring images according to the first offset and the second offset; Determine the viewing position of the user relative to the screen based on the offset of the user in each set of target monitoring images, including: Calculating each first candidate viewing position determined by the user based on each group of target monitoring images according to the user's offset in each group of target monitoring images; The offset of the user in each group of target monitoring images is used as a weight, and a weighted average calculation is performed on each of the first candidate viewing positions to obtain a first actual viewing position of the user relative to the screen.

2. A device for determining a viewing position of a user relative to a naked-eye 3D display device, characterized in that: include: A target monitoring image determination module, used to determine at least one group of target monitoring images including user facial information from at least two groups of candidate monitoring images; wherein each group of candidate monitoring images is acquired by a group of image acquisition modules provided on the naked-eye 3D display device, and the number of the image acquisition modules is at least two groups; A user offset determination module, used to determine the offset of the user in each group of target monitoring images; Each set of target monitoring images includes a first view and a second view; The user offset determination module includes: a view offset determination unit, configured to determine a first offset of a user in any group of target monitoring images according to a first view in the first view; and determine a second offset of a user in the second view according to a second view in the group of target monitoring images; A user offset determination unit, configured to determine an offset of a user in the group of target monitoring images according to the first offset and the second offset; a view offset determination unit, specifically configured to use the coordinates of the user's face center in the first view relative to the center point of the first view as a first offset of the user in the first view; and use the coordinates of the user's face center in the second view relative to the center point of the second view as a second offset of the user in the second view; A viewing position determination module, used to determine the viewing position of the user relative to the screen according to the offset of the user in each group of target monitoring images; The viewing position determination module includes a first candidate viewing position determination unit, which is used to calculate each first candidate viewing position determined by the user based on each group of target monitoring images according to the user's offset in each group of target monitoring images; and a first actual viewing position determination unit, which is used to use the user's offset in each group of target monitoring images as a weight, and perform weighted average calculation on each of the first candidate viewing positions to obtain the user's first actual viewing position relative to the screen.

3. An electronic device, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method for determining the viewing position of a user relative to the naked-eye 3D display device as described in claim 1.

4. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method for determining the viewing position of a user relative to a naked-eye 3D display device as claimed in claim 1 is implemented.