A display control method and system

Abstract

Embodiments of the present specification provide a display control method and system, the method comprising: acquiring image information of one or more users located within a preset area range of a display device; determining at least one in-system user in the one or more users, identity information of each in-system user, and viewing information of the display device of each in-system user based on the image information; determining a user category to which each in-system user belongs based on the identity information; for each user category, determining a viewing weight corresponding to the user category based on the user category and the viewing information of the in-system user belonging to the user category; and determining a display mode of the display device based on a numerical relationship of the viewing weights corresponding to the user categories.

Description

TECHNICAL FIELD

[0001] The present specification relates to the field of intelligent control, and in particular, to a display control method and system. BACKGROUND

[0002] Actual operation scenarios of an enterprise (for example, a conference scenario, a presentation scenario, a demonstration scenario, and the like) often involve simultaneous observation or collaborative decision-making of a plurality of members, and different members often have different focuses and needs for information displayed on a display device (for example, a display screen for presenting content). Meanwhile, members with different identities or ranks (for example, there are members of the management and ordinary employees in a conference scenario) also have different importance in the observation or decision-making process. Therefore, it is particularly important to dynamically display personalized information related to the observation members or decision-making members on the display screen to meet the viewing needs of each member and better accommodate the viewing experience of important members (for example, members with high ranks).

[0003] Therefore, it is desirable to provide a display control method and system. SUMMARY

[0004] One or more embodiments of the present specification provide a display control method. The display control method comprises: acquiring image information of one or more users located within a preset area range of a display device; determining at least one system user in the one or more users, identity information of each system user, and observation screen information of each system user on the display device based on the image information; determining a user category to which each system user belongs based on the identity information; for each user category, determining an observation screen weight corresponding to the user category based on the user category and the observation screen information of the system user belonging to the user category; and determining a display mode of the display device based on a numerical relationship of the observation screen weights corresponding to each user category.

[0005] In some embodiments, for each user category, a preset weight corresponding to the user category is acquired; a first coefficient corresponding to the user category is determined based on the preset weight corresponding to the user category and a number of users; a second coefficient corresponding to the user category is determined based on the observation screen information of the system user belonging to the user category and the preset weight corresponding to the user category; and the observation screen weight corresponding to the user category is determined based on the first coefficient and the second coefficient.

[0006] In some embodiments, for the at least one in-system user, at least one intended user viewing the display device is determined based on the screen watching information; distance information and gaze duration of the at least one intended user to the display device are determined based on the screen watching information; for each of the user categories, the second coefficient of the user category is determined based on the distance information and the gaze duration of the intended user belonging to the user category.

[0007] In some embodiments, the screen watching weights corresponding to all the user categories are sorted from large to small to obtain a sorting result; it is judged whether the numerical relationship satisfies a first preset condition based on the sorting result; in response to the numerical relationship satisfying the first preset condition, the display mode is determined as the main screen exclusive mode; in response to the numerical relationship not satisfying the first preset condition, it is judged whether the numerical relationship satisfies a second preset condition; in response to the numerical relationship satisfying the second preset condition, the display mode is determined as the split screen negotiation mode; in response to the numerical relationship not satisfying the second preset condition, it is judged whether the numerical relationship satisfies a third preset condition; in response to the numerical relationship satisfying the third preset condition, the display mode is determined as the main and auxiliary screen mode.

[0008] In some embodiments, in response to the display mode being the main screen exclusive mode, a display interface of the display device is controlled to display only the display content corresponding to the user category corresponding to the first screen watching weight.

[0009] In some embodiments, in response to the display mode being the split screen negotiation mode, the display interface of the display device is divided into a first display area and a second display area; the first display area is controlled to display the display content corresponding to the user category corresponding to the first screen watching weight; and the second display area is controlled to display the display content corresponding to the user category corresponding to the second screen watching weight.

[0010] In some embodiments, in response to the display mode being the main and auxiliary screen mode, a plurality of shortlisted user categories are determined; the display interface of the display device is divided into a plurality of display areas; the at least one main display area is controlled to display the display content corresponding to the at least one main user category, respectively, and the at least one auxiliary display area is controlled to display the display content corresponding to the at least one auxiliary user category, respectively.

[0011] In some embodiments, based on the display mode in which the display device is currently in, a plurality of legitimate users are determined; based on the screen watching information of the plurality of legitimate users, a display module to be enlarged is determined.

[0012] In some embodiments, when the display device is in the split-screen negotiation mode: in response to the presence of the display module to be zoomed in both the first display area and the second display area, determining a conflict arbitration score of the first user category and the second user category based on the user level and the line-of-sight projection angle of each of the legitimate users in the first user category and the second user category, and the service importance of the display module to be zoomed in; determining a target display module based on the conflict arbitration score, and displaying the target display module in zoom-in in the split-screen area.

[0013] In some embodiments, when the display device is in the primary-secondary screen mode: in response to the presence of the display module to be zoomed in the primary display area, determining the display module to be zoomed in present in the primary display area as a target display module, and displaying the target display module in zoom-in in the primary display area or across the split-screen area; in response to the presence of the display module to be zoomed in the secondary display area and the absence of the display module to be zoomed in the primary display area, determining the display module to be zoomed in present in the secondary display area as the target display module, and displaying the target display module in zoom-in in the primary display area or across the split-screen area.

[0014] In some embodiments, determining at least one non-system user and the viewing screen information of each non-system user from the one or more users based on the image information; determining a viewing screen scenario based on the user category to which the at least one system user belongs and the viewing screen information, and the viewing screen information of the at least one non-system user; adjusting the display mode based on the viewing screen scenario.

[0015] In some embodiments, in response to the viewing position of the system user being located in the central area of the viewing positions of the non-system users: determining the viewing screen scenario as the explanation demonstration scenario; adjusting the display mode of the display device to the primary screen exclusive mode, and controlling the display interface of the display device to display the display content corresponding to the user category to which the system user belongs located in the central area.

[0016] In some embodiments, for each of the non-system users, determining the position feature count of the non-system user; and in response to the position feature count of all the non-system users being greater than zero: determining the viewing screen scenario as the explanation demonstration scenario; adjusting the display mode of the display device to the primary screen exclusive mode, and controlling the display interface of the display device to display the display content corresponding to the user category to which the system user belongs adjacent to the viewing position of the non-system user.

[0017] The one or more embodiments of the specification provide a display control system. The display control system comprises: an acquisition module configured to acquire image information of one or more users within a preset area of a display device; a user determination module configured to determine at least one in-system user from the one or more users, identity information of each in-system user, and screen viewing information of the display device for each in-system user based on the image information; a category determination module configured to determine a user category to which each in-system user belongs based on the identity information; a weight determination module configured to determine, for each user category, a corresponding screen viewing weight of the user category based on the user category and the screen viewing information of the in-system users belonging to the user category; and a mode determination module configured to determine a display mode of the display device based on a numerical relationship of the screen viewing weights corresponding to each user category.

[0018] The one or more embodiments of the specification provide a display control device comprising a processor configured to execute a display control method.

[0019] The one or more embodiments of the specification provide a computer readable storage medium storing computer instructions, wherein when a computer reads the computer instructions in the storage medium, the computer executes a display control method. BRIEF DESCRIPTION OF DRAWINGS

[0020] The specification will be further illustrated in the form of exemplary embodiments, which will be described in detail with reference to the accompanying drawings. These embodiments are not limiting, and in these embodiments, the same numbers represent the same structures, wherein:

[0021] Figure 1 is a schematic diagram of an application scenario of a display control system according to some embodiments of the specification;

[0022] Figure 2 is a module diagram of a display control system according to some embodiments of the specification;

[0023] Figure 3 is an exemplary flowchart of a display control method according to some embodiments of the specification;

[0024] Figure 4A is a schematic diagram of a main screen exclusive mode according to some embodiments of the specification;

[0025] Figure 4B is a schematic diagram of a split screen negotiation mode according to some embodiments of the specification;

[0026] Figure 4C is a schematic diagram of a main and auxiliary screen mode according to some embodiments of the specification;

[0027] Figure 5A is a schematic diagram of a user viewing position according to some embodiments of the present specification;

[0028] Figure 5B is a schematic diagram of a user viewing position according to some other embodiments of the present specification;

[0029] Figure 6 is an exemplary flowchart of determining a viewing weight according to some embodiments of the present specification; and

[0030] Figure 7 is an exemplary flowchart of determining a display mode according to some embodiments of the present specification. DETAILED DESCRIPTION

[0031] In order to more clearly illustrate the technical solutions of the embodiments of the present specification, the following will briefly introduce the drawings needed to be used in the embodiments description. Obviously, the drawings in the following description are only some examples or embodiments of the present specification, and for those skilled in the art, the present specification can also be applied to other similar scenarios without creative labor on the basis of these drawings. Unless it is clear from the language context or otherwise indicated, the same reference numbers in the drawings represent the same structure or operation.

[0032] It should be understood that the "system", "device", "unit" and / or "module" used herein is a method for distinguishing different components, elements, parts, portions or assemblies at different levels. However, if other words can achieve the same purpose, the words can be replaced by other expressions.

[0033] As shown in the specification and claims, unless the context clearly indicates otherwise, the words "one", "a", "an", and / or "the" do not mean to specify a single number, but can also include a plurality. Generally speaking, the terms "comprise" and "include" only indicate the inclusion of the steps and elements explicitly identified, and these steps and elements do not constitute an exclusive list, and the method or device can also include other steps or elements.

[0034] Flowcharts are used in the present specification to illustrate the operations performed by the system according to the embodiments of the present specification. It should be understood that the preceding or subsequent operations are not necessarily performed in sequence. On the contrary, each step can be processed in reverse order or simultaneously. At the same time, other operations can also be added to these processes, or one or more steps of the operation can be removed from these processes.

[0035] Figure 1 is a schematic diagram of an application scenario of a display control system according to some embodiments of the present specification. As Figure 1As shown, an application scenario 100 of a display control system (hereinafter referred to as application scenario 100 ) may include a processing device 110 , a network 120 , a storage device 130 , a display device 140 , an image acquisition apparatus 150 , and one or more users 160 .

[0036] The processing device 110 is used to process the data and / or information obtained from the storage device 130 and / or the image acquisition device 150, and to control the display mode and / or display content of the display device 140. For example, the processing device 110 can obtain the image information (for example, the user's facial image) of one or more users 160 located within the preset area of ​​the display device from the image acquisition device 150, and determine at least one in-system user among the one or more users 160 and the screen viewing information of each in-system user on the display device 140 based on the image information. For another example, the processing device 110 can retrieve the identity information of each in-system user from the storage device 130 based on the determined at least one in-system user. For another example, the processing device 110 can determine the user category to which each in-system user belongs based on the identity information; determine the screen viewing weight corresponding to each user category based on the user category and the screen viewing information; and determine the display mode of the display device based on the numerical relationship between the screen viewing weights corresponding to each user category. For more information about the processing device 110, please refer to Figure 3 、 Figure 6 and Figure 7 and its related descriptions.

[0037] In some embodiments, processing device 110 may include a processor. In some embodiments, processing device 110 may be a single server or a group of servers.

[0038] The network 120 is used to connect the various components of the application scenario 100 and / or connect the system with external resources. The network 120 enables communication between the various components and with other components outside the system to achieve the exchange of data and / or information. For example, the network 120 can transmit image information of one or more users 160 captured by the image acquisition device 150 to the processing device 110. For another example, the network 120 can transmit instructions generated by the processing device 110 to control the display mode of the display device 140 (for example, instructions to control the display mode of the display device 140 to adjust to the main screen exclusive mode) to the display device 140.

[0039] The network 120 can be a wireless or wired network and use standard communication techniques and / or protocols. For example, the network 120 can be the Internet or any other public or private network, including, but not limited to, a Local Area Network (LAN), a Metropolitan Area Network (MAN), a Wide Area Network (WAN), a mobile, wired or wireless network, a private network, or a virtual private network, or any combination thereof.

[0040] The storage device 130 is configured to store data and / or instructions. For example, the storage device 130 can store image information of one or more users 160 acquired by the image acquisition device 150. For another example, the storage device 130 can store identity information (e.g., user ID, name, affiliated enterprise, etc.) input by the one or more users 160, and a correspondence between the image information and the identity information of each of the one or more users 160. The storage device 130 can be implemented in a single central server, multiple servers connected through a communication link, or multiple personal devices.

[0041] The display device 140 refers to a device configured to present display content (e.g., text, pictures, videos, etc.), such as a display screen, a projection screen, a television screen, etc. In some embodiments, the display device 140 can also be a multi-screen display system composed of multiple screens (e.g., multiple display screens).

[0042] In some embodiments, the display device 140 can be configured with an observation device (e.g., an Ultra-Wideband (UWB) device, a Time of Flight (TOF) sensor, etc.) to determine the distance, coordinates, and / or direction (angle) of the one or more users 160 relative to the display device 140.

[0043] The image acquisition device 150 is configured to acquire image information of the one or more users 160. For example, the image acquisition device 150 can include a video camera, a camera, a photographing device, etc., and the image information can be a picture or a video of the user containing the face of the user. In some embodiments, the image acquisition device 150 further includes a biological information recognition device to acquire eye movement tracks, pupil changes, etc. of the one or more users 160.

[0044] In some embodiments, the image acquisition device 150 can be integrated inside or on the surface of the display device 140, i.e., the image acquisition device 150 is a component of the display device 140 and directly connected to other parts of the display device 140.

[0045] In some embodiments, the image acquisition device 150 can be independent of the display device 140.

[0046] One or more users 160 can interact with the display device 140 or view the content displayed by the display device 140. For example, the one or more users 160 can include at least one management personnel (e.g., a manager, a supervisor, etc.) within an enterprise, an employee, etc. In some embodiments, the one or more users 160 include in-system users and out-of-system users. For example Figure 1 As shown, the one or more users 160 include in-system users 161, 163, 164, and 165, etc., and out-of-system users 162, etc. More information about the in-system users and the out-of-system users can be found in Figure 3 and the related description.

[0047] Figure 2 is an exemplary block diagram of a display control system according to some embodiments of the present disclosure. As shown Figure 2 The display control system 200 can include an acquisition module 210, a user determination module 220, a category determination module 230, a weight determination module 240, and a mode determination module 250.

[0048] The acquisition module 210 is configured to acquire image information of one or more users located within a preset area range of a display device. More information about the acquisition module 210 can be found in Figure 3 and the related description.

[0049] The user determination module 220 is configured to determine, based on the image information, at least one in-system user among the one or more users, identity information of each in-system user, and viewing information of each in-system user on the display device.

[0050] In some embodiments, the user determination module 220 is further configured to determine, based on the image information, at least one out-of-system user among the one or more users and viewing information of each out-of-system user, determine a viewing scenario based on a user category to which the at least one in-system user belongs and the viewing information, and the viewing information of the at least one out-of-system user, and adjust a display mode based on the viewing scenario.

[0051] In some embodiments, the user determination module 220 is further configured to determine, in response to a viewing position of the in-system user being located in a central area of a viewing position of the out-of-system user, that the viewing scenario is a presentation explanation scenario, adjust the display mode of the display device to a main screen exclusive mode, and control the display interface of the display device to display display content corresponding to a user category to which the in-system user located in the central area belongs.

[0052] In some embodiments, the user determining module 220 is further configured to: determine, for each non-system-in user respectively, a location feature count of the non-system-in user; determine that the viewing scene is a presentation scene in response to the location feature count of all non-system-in users being greater than zero; adjust a display mode of the display device to a main screen exclusive mode, and control the display interface of the display device to display display content corresponding to a user category to which a system-in user adjacent to the viewing location of the non-system-in user belongs.

[0053] Further description of the user determining module 220 can be found in Figure 3 and related descriptions thereof.

[0054] The category determining module 230 is configured to determine, based on the identity information, a user category to which each system-in user belongs. Further description of the category determining module 230 can be found in Figure 3 and related descriptions thereof.

[0055] The weight determining module 240 is configured to determine, for each user category respectively, a viewing weight corresponding to the user category based on the viewing information of the user category and the system-in users belonging to the user category.

[0056] In some embodiments, the weight determining module 240 is further configured to: obtain a preset weight corresponding to the user category; determine a first coefficient corresponding to the user category based on the preset weight corresponding to the user category and the number of users; determine a second coefficient corresponding to the user category based on the viewing information of the system-in users belonging to the user category and the preset weight corresponding to the user category; and determine the viewing weight corresponding to the user category based on the first coefficient and the second coefficient.

[0057] In some embodiments, the weight determining module 240 is further configured to: determine, for at least one system-in user, at least one intended user viewing the display device based on the viewing information; determine distance information and gaze duration of the at least one intended user to the display device based on the viewing information; and determine, for each user category respectively, a second coefficient of the user category based on the distance information and the gaze duration of the intended users belonging to the user category.

[0058] Further description of the weight determining module 240 can be found in Figure 3 and related descriptions thereof.

[0059] The mode determining module 250 is configured to determine a display mode of the display device based on a numerical relationship of the viewing weights corresponding to the user categories.

[0060] In some embodiments, the mode determining module 250 is further configured to: sort the viewing weights corresponding to all user categories in descending order to obtain a sorting result; determine whether the numerical relationship satisfies a first preset condition based on the sorting result; determine the display mode as the main screen exclusive mode in response to the numerical relationship satisfying the first preset condition; determine whether the numerical relationship satisfies a second preset condition in response to the numerical relationship not satisfying the first preset condition; determine the display mode as the split screen negotiation mode in response to the numerical relationship satisfying the second preset condition; determine whether the numerical relationship satisfies a third preset condition in response to the numerical relationship not satisfying the second preset condition; and determine the display mode as the main and auxiliary screen mode in response to the numerical relationship satisfying the third preset condition.

[0061] In some embodiments, the mode determining module 250 is further configured to: control the display interface of the display device to display only the display content corresponding to the user category corresponding to the first viewing weight in response to the display mode being the main screen exclusive mode.

[0062] In some embodiments, the mode determining module 250 is further configured to: divide the display interface of the display device into a first display area and a second display area in response to the display mode being the split screen negotiation mode.

[0063] In some embodiments, the mode determining module 250 is further configured to: control the first display area to display the display content corresponding to the user category corresponding to the first viewing weight, and control the second display area to display the display content corresponding to the user category corresponding to the second viewing weight in response to the display mode being the split screen negotiation mode.

[0064] In some embodiments, the mode determining module 250 is further configured to: determine a plurality of shortlisted user categories in response to the display mode being the main and auxiliary screen mode; divide the display interface of the display device into a plurality of display areas; control at least one main display area to display the display content corresponding to at least one main user category, and control at least one auxiliary display area to display the display content corresponding to at least one auxiliary user category.

[0065] In some embodiments, the mode determining module 250 is further configured to: determine a plurality of legal users based on the display mode in which the display device is currently located; and determine the display module to be enlarged based on the viewing information of the plurality of legal users.

[0066] In some embodiments, the mode determining module 250 is further configured to: when the display device is in the split-screen negotiation mode, in response to the existence of the display module to be zoomed in both the first display area and the second display area, determine the conflict arbitration score of the first user category and the second user category based on the user level and the line-of-sight projection angle of each legitimate user in the first user category and the second user category, and the service importance of the display module to be zoomed in; and determine the target display module based on the conflict arbitration score, and display the target display module in the split-screen area or zoom in the target display module.

[0067] In some embodiments, the mode determining module 250 is further configured to: when the display device is in the primary-secondary screen mode, in response to the existence of the display module to be zoomed in the primary display area, determine the display module to be zoomed in the primary display area as the target display module, and display the target display module in the primary display area or zoom in the target display module; and in response to the existence of the display module to be zoomed in the secondary display area and the non-existence of the display module to be zoomed in the primary display area, determine the display module to be zoomed in the secondary display area as the target display module, and display the target display module in the primary display area or zoom in the target display module.

[0068] Further description of the mode determining module 250 can be found in Figure 3 and the related description.

[0069] It should be noted that the above description of the display control system 200 and its modules is for the convenience of description, and cannot limit the scope of the embodiments. It can be understood that, after understanding the principle of the system, those skilled in the art can combine the modules or connect the modules to form a subsystem without departing from the principle. In some embodiments, Figure 2 The acquisition module 210, the user determining module 220, the category determining module 230, the weight determining module 240 and the mode determining module 250 disclosed in the embodiments can be different modules in a system, or can be a module to realize the functions of two or more modules. For example, the modules can share a storage module, or each module can have its own storage module. Variations such as this are within the scope of protection of the present disclosure.

[0070] Figure 3 is an exemplary flowchart of a display control method according to some embodiments of the present disclosure. As shown in Figure 3 , the flow 300 includes the following steps. In some embodiments, the flow 300 can be performed by the processing device 110 or the display control system 200.

[0071] At step 310, image information of one or more users located within a preset area range of the display device is acquired. In some embodiments, step 310 can be performed by the processing device 110 or the acquisition module 210.

[0072] A display device (e.g., the display device 140) refers to a device for presenting display content, such as a display screen, a projection screen, a television screen, etc.

[0073] Display content refers to media content presented by a display interface (e.g., a displayable area of a display screen) of a display device. The display content can include pure text, a report, a picture, a video, etc.

[0074] It should be noted that one display content corresponds to a media content collection rather than a single media content. For example, one display content can include multiple pictures. For another example, one display content can include two reports, two pictures, and a video, etc.

[0075] The preset area range refers to a two-dimensional area range in a horizontal direction in front of the display device. The front of the display device refers to a direction in which a display interface of the display device is directly facing. The shape and size of the preset area range can be preset. For example, the preset area range can be a rectangular area on the ground in front of the display device, with an area of 200m 2 . For another example, the preset area range can be a semicircular horizontal plane area in front of the display device, with a radius of 30m, and with a geometric center of the display device as the center. In the horizontal direction, part of the boundary of the preset area range can be in close proximity to the display device, or can be spaced apart from the display device by a preset distance. For example, taking the shape of the preset area range as a semicircle (the semicircle includes a straight edge and a semicircular edge) as an example, the straight edge of the preset area range can be spaced apart from the front surface (i.e., the surface on which the display interface is located) of the display device by a preset distance, which can be 0.5m, 1m, 1.5m, etc.

[0076] A user (e.g., one or more users 160) refers to a person who interacts with a display device or watches content displayed by the display device. For example, an enterprise member participating in a meeting, a person watching a speech, etc.

[0077] In some embodiments, the display device can be configured with an observation device (e.g., an UWB (Ultra-Wideband) device, a TOF (Time of Flight) sensor, etc.). The observation device is used to determine a screen viewing position of one or more users. The screen viewing position of one user includes the distance, coordinates, and / or direction (angle) of the user relative to the display device, etc.

[0078] Exemplarily, the observation device is taken as an example of a UWB device, which includes a UWB base station and a UWB tag. The UWB tag can be worn by each user (for example, the UWB tag is configured on the user's body through a bracelet or a badge), and the UWB base station can be configured on the display device. The UWB tag is used to emit a pulse signal (for example, a nanosecond-level non-sine wave narrow pulse), and the UWB base station is used to receive the pulse signal emitted by each UWB tag and calculate the distance and / or direction of each UWB tag relative to the UWB base station, respectively. Based on this, the processing device 110 or the acquisition module 210 can determine the distance and / or direction of each user relative to the display device as the viewing position of each user through the UWB device, and then determine whether each user is located within the preset area range in combination with the position and size of the preset area range.

[0079] As another example, the observation device is taken as an example of a TOF sensor. The TOF sensor can emit a light signal and receive a light signal reflected by the user, and calculate the round-trip time of the light signal between the TOF sensor and each user, thereby calculating the distance and / or direction of each user relative to the TOF sensor. Based on this, the processing device 110 or the acquisition module 210 can determine the distance of each user relative to the display device as the viewing position of each user through the TOF sensor, and then determine whether each user is located within the preset area range in combination with the position and size of the preset area range.

[0080] The image information refers to an image or a video related to the user, for example, a facial image and / or a body posture image of the user. For example, the image acquisition device can be a camera, which is used to capture the facial image and / or the body posture image of the user. The processing device 110 or the acquisition module 210 can acquire the image information of the user through the image acquisition device (for example, the image acquisition device 150).

[0081] In some embodiments, the image information further includes eye movement trajectory information and / or pupil change information of the user. The eye movement trajectory information reflects the trajectory of the user's visual line on the landing point of the object surface observed by the user, and the pupil change information reflects the change of the pupil size of the user when watching the display device.

[0082] In some embodiments, the image acquisition device can be configured with a biological information recognition device to acquire the eye movement trajectory information and / or the pupil change information of the user. For example, the biological information recognition device can be an eye tracker applying eye movement tracking technology, which is used to acquire the eye movement trajectory information of the user.

[0083] In some embodiments, the image acquisition device can acquire the image information of the user within the preset area of the display device at a preset frequency and transmit the image information to the processing device 110 or the acquisition module 210. An exemplary preset frequency can be 60 times per minute, 30 times per minute, 20 times per minute, etc.

[0084] At step 320, at least one system user in the one or more users, identity information of each system user, and viewing information of each system user to the display device are determined based on the image information. In some embodiments, step 320 can be performed by the processing device 110 or the user determination module 220.

[0085] A system user refers to a user whose identity information has been entered in a personnel management system (for example, a personnel management system established in a storage device). For example, taking the application scenario of the display control system 200 as a visit exhibition scenario, the personnel management system can be an application program established by an exhibition organizer for exhibition personnel management, and the system user can be an enterprise member invited to visit the exhibition. The identity information of these enterprise members has been entered in the personnel management system in advance, and therefore, these enterprise members are referred to as system users.

[0086] It can be understood that, in the application scenario of the display control system 200, in addition to the system user, there can also be a non-system user. For example, still taking the application scenario of the display control system 200 as a visit exhibition scenario, there can also be personnel who are not invited but still visit the exhibition among the users visiting the exhibition. The exhibition behavior of these personnel cannot be predicted in advance, and therefore, the identity information of these personnel cannot be entered in the personnel management system in advance, and these personnel are referred to as non-system users.

[0087] Identity information refers to information related to the identity of a user. The identity information can include the ID, name, affiliated enterprise, type of the affiliated enterprise (for example, investment enterprise, general contractor enterprise, construction enterprise) of the user, etc. For example, the identity information of the user can be “ID: 0275, name: Zhang San, affiliated enterprise: A enterprise, and type of the affiliated enterprise: construction enterprise”.

[0088] In some embodiments, the processing device 110 or the user determining module 220 can match, for each acquired user's image information, a face image (hereinafter referred to as a current face image) in the user's image information with each user's pre-stored face image (hereinafter referred to as a pre-stored face image) in a storage device (e.g., the storage device 130), and determine the user as a system user if there is a pre-stored face image that matches the current face image. The aforementioned matching refers to determining the similarity between each pre-stored face image and the current face image, and the matching success refers to that the aforementioned similarity is greater than a pre-set similarity threshold. In combination with the foregoing, the storage device can store the identity information of one or more users, and the correspondence between the image information and the identity information of each user in the one or more users, based on which the processing device 110 or the user determining module 220 can determine the identity information corresponding to the pre-stored face image that matches the current face image as the identity information of the user.

[0089] In some embodiments, the processing device 110 or the user determining module 220 can be configured with an image recognition model. The image recognition model is a machine learning model (e.g., a Convolutional Neural Network (CNN) model, etc.), the input of which is the currently acquired user's image information, and the output of which is whether the user is a system user and the identity information of the system user.

[0090] In some embodiments, the processing device 110 or the user determining module 220 can also determine at least one system user and the identity information of each system user in other ways, which are not limited herein.

[0091] The screen watching information refers to information reflecting the user's behavior when watching the display device. The screen watching information includes whether the user is currently gazing at the display device, the position relative to the display device when gazing at the display device, the duration of gazing at the display device, etc. For example, the screen watching information of a certain user can be "currently gazing at the display device, located directly in front of the display device, 5m away from the display device in a straight line, and has gazed for 2 minutes".

[0092] In some embodiments, the processing device 110 or the user determining module 220 can determine whether the system user is gazing at the display device based on the eye movement trajectory information in the image information. For example, the processing device 110 or the user determining module 220 can determine the line of sight landing point corresponding to the time point in the eye movement trajectory based on the time point when the image information is acquired, and determine that the system user is gazing at the display device if the line of sight landing point is located on the display device.

[0093] In some embodiments, the duration of the gazing at the display device by the in-system user can be determined based on the number of times the in-system user is continuously determined to be gazing at the display device within the system. For example, assuming that the image capture device acquires image information (including eye movement trajectory information) at a frequency of 60 times per minute (i.e., once per second) (it can be understood that each time image information is acquired, it is determined whether the in-system user is gazing at the display device), if the in-system user is determined to be gazing at the display device based on the latest acquired eye movement trajectory information, and before this determination, the in-system user has been determined to be gazing at the display device for 22 consecutive times, then the duration of the gazing at the display device by the in-system user is 22 + 1 = 23 seconds.

[0094] In some embodiments, the position of the in-system user relative to the display device when gazing at the display device can be determined based on the distance and direction of the in-system user relative to the display device. The method for acquiring the distance and direction can be referred to the foregoing description. In some embodiments, the coordinate value of the in-system user relative to the display device (i.e., the coordinate value with the geometric center point of the display device as the origin) can be calculated based on the distance and direction of the in-system user relative to the display device, as the position of the in-system user relative to the display device when gazing at the display device.

[0095] Step 330, determining the user category to which each in-system user belongs based on the identity information. In some embodiments, step 330 can be performed by the processing device 110 or the category determination module 230.

[0096] The user category refers to the classification category to which the in-system user belongs. The number of user categories is multiple, and each user category includes one or more in-system users.

[0097] In some embodiments, the user category is related to the enterprise to which the user belongs. In some embodiments, the user category can be divided based on the job level of the in-system user in the enterprise. For example, the number of user categories can be 4, and the 4 user categories are respectively director category, senior management category, middle management category, and employee category. Among them, the director category includes the chairman and directors of the enterprise, the senior management category includes the general manager, deputy general manager, director, and deputy director of the enterprise, the middle management category includes the managers, deputy managers, and supervisors of each department of the enterprise, and the employee category includes the ordinary employees of the enterprise.

[0098] In some embodiments, the processing device 110 or the user determining module 220 can access an internal system (e.g., a personnel management system, an office automation (OA) system, etc.) of an enterprise to which the in-system user belongs in each system, and based on the identity information (e.g., a user ID or a name) of the in-system user in each system, query the position of the in-system user in the enterprise internal system, and then determine the user category to which the in-system user in each system belongs. For example, the in-system user Zhang San belongs to enterprise A, and the processing device 110 or the user determining module 220 can access the OA system of enterprise A and query the position of Zhang San. For example, it is assumed that the position of Zhang San is found to be a personnel department manager, and the user category to which Zhang San belongs is a middle management category.

[0099] In some embodiments, each user category corresponds to a display content that is of interest to or desired to be seen by the in-system user in the user category. For example, the display content corresponding to the director category user can be an enterprise revenue report, a new product display video, etc. For another example, the display content corresponding to the middle management category user can be a performance summary table, a work arrangement for the next quarter, etc.

[0100] At step 340, for each user category, a screen viewing weight corresponding to the user category is determined based on the user category and the screen viewing information of the in-system user belonging to the user category. In some embodiments, step 340 can be performed by the processing device 110 or the weight determining module 240.

[0101] The screen viewing weight refers to a numerical value used to measure the priority of the user in the allocation of display resources of the display device. The greater the value of the screen viewing weight corresponding to the user category, the higher the degree of attention and importance of the user category, and the display form of the display content of the display device is more inclined to the in-system user belonging to the user category. For example, the user category with a greater value of the screen viewing weight has a greater area ratio of the display content in the display interface of the display device.

[0102] In some embodiments, for each of the user categories, the processing device 110 or the weight determining module 240 can obtain a preset weight corresponding to the user category, determine a screen viewing proportion based on the screen viewing information of the in-system user belonging to the user category, and determine a screen viewing weight corresponding to the user category based on the preset weight and the screen viewing proportion corresponding to the user category.

[0103] The preset weight refers to a value preset for each user category, reflecting the importance of each user category. For example, the preset weights of the director category, the senior management category, the middle management category, and the employee category can be sequentially reduced according to the levels of the system users included in the user categories, and are 10, 5, 3, and 1, respectively. For another example, the preset weights of the director category, the senior management category, the middle management category, the senior employee category (for example, engineers, designers, etc.), and the ordinary employee category can be 5, 4, 3, 2, and 1, respectively.

[0104] The preset weight corresponding to each user category can be pre-stored in a storage device (for example, the storage device 130), and the processing device 110 or the weight determination module 240 can call the preset weight of each user category from the storage device.

[0105] The screen watching ratio refers to the proportion of the system users in a user category who are watching the display device to all the system users in the user category. For example, a user category includes 5 system users, of which 2 system users are watching the display device, and the screen watching ratio of the user category is 40%.

[0106] After obtaining the preset weight of the user category and determining the screen watching ratio, the processing device 110 or the weight determination module 240 can calculate the screen watching weight corresponding to the user category based on the preset weight and the screen watching ratio corresponding to the user category. For example, the product of the preset weight and the screen watching ratio corresponding to the user category is taken as the screen watching weight corresponding to the user category.

[0107] In some embodiments, for each of the user categories, the processing device 110 or the weight determination module 240 can obtain the preset weight corresponding to the user category; determine a first coefficient corresponding to the user category based on the preset weight and the number of users corresponding to the user category; determine a second coefficient corresponding to the user category based on the screen watching information of the system users belonging to the user category and the preset weight corresponding to the user category; and determine the screen watching weight corresponding to the user category based on the first coefficient and the second coefficient. More details about this embodiment can be found in Figure 6 and the related description thereof.

[0108] Step 350, determining the display mode of the display device based on the numerical relationship of the screen watching weights corresponding to each user category. In some embodiments, step 350 can be performed by the processing device 110 or the mode determination module 250.

[0109] The numerical relationship of the screen watching weights corresponding to each user category refers to the mathematical relationship of the screen watching weight values corresponding to each user category, such as the size relationship, the proportion relationship, the multiple relationship, etc.

[0110] A display mode refers to the layout of the displayed content on a display interface of a display device (e.g., display device 140). Different layout modes display different amounts of content and have different attributes (e.g., position, shape, size, etc.) of the displayed content.

[0111] In some embodiments, the display modes include main screen exclusive mode, split screen negotiation mode and main and sub-screen mode.

[0112] The main screen exclusive mode means that the display interface of the display device includes only one display area, and the display area is exclusively occupied by one display content.

[0113] Figure 4A This is a schematic diagram of the main screen exclusive mode shown in some embodiments of this specification.

[0114] For example, Figure 4A As shown, the display interface 400 of the display device includes only one display area 411 , and the display area 411 is exclusively occupied by one display content.

[0115] The split-screen negotiation mode means that the display interface of the display device is divided into two display areas (a first display area and a second display area) arranged left and right or up and down, and each display area presents one display content.

[0116] Figure 4B This is a schematic diagram of the split-screen negotiation mode shown in some embodiments of this specification.

[0117] For example, Figure 4B As shown, the display interface 400 of the display device presents a first display area 421 and a second display area 422 arranged left and right, and the first display area 421 and the second display area 422 respectively present different display contents.

[0118] The main-sub-screen mode means that the display interface of the display device is divided into multiple display areas, and the multiple display areas include at least one main display area and at least one sub-display area, and the area of ​​the main display area is larger than the area of ​​each sub-display area.

[0119] Figure 4C This is a schematic diagram of the main-secondary screen mode according to some embodiments of this specification.

[0120] For example, Figure 4C As shown, the display interface 400 of the display device presents three display areas arranged left and right, including a main display area 431, a sub-display area 432 and a sub-display area 433, and the above three display areas respectively present different display contents.

[0121] In some embodiments, the processing device 110 or the mode determining module 250 can sort the viewing weights corresponding to all user categories in descending order to obtain a sorting result; determine whether the numerical relationship satisfies a first preset condition based on the sorting result; in response to the numerical relationship satisfying the first preset condition, determine that the display mode is the main screen exclusive mode; in response to the numerical relationship not satisfying the first preset condition, determine whether the numerical relationship satisfies a second preset condition; in response to the numerical relationship satisfying the second preset condition, determine that the display mode is the split screen negotiation mode; in response to the numerical relationship not satisfying the second preset condition, determine whether the numerical relationship satisfies a third preset condition; and in response to the numerical relationship satisfying the third preset condition, determine that the display mode is the main and auxiliary screen mode. More details about this embodiment can be found in Figure 7 and the related description.

[0122] In some embodiments, as shown in Figure 3 the flow 300 further includes the following steps 360 to 380.

[0123] Step 360: determining at least one non-system-in user and viewing information of each non-system-in user from one or more users based on the image information. In some embodiments, step 360 can be performed by the processing device 110 or the user determining module 220.

[0124] In combination with the foregoing, the system-in user refers to a user who has completed identity information input in the personnel management system. Based on this, the non-system-in user refers to a user who has not completed identity information input in the personnel management system. More details about the non-system-in user can be found in the foregoing description.

[0125] In combination with the foregoing, the viewing information refers to information reflecting the behavior of a user when watching the display device.

[0126] In some embodiments, the processing device 110 or the user determining module 220 can determine the viewing information of the non-system-in user based on a method similar to that of determining the viewing information of the system-in user, and more details can be found in the foregoing description, which will not be repeated here.

[0127] Step 370: determining a viewing scene based on the user category to which the at least one system-in user belongs and the viewing information, and the viewing information of the at least one non-system-in user. In some embodiments, step 370 can be performed by the processing device 110 or the mode determining module 250.

[0128] The viewing scene reflects the viewing scene of the display device by all users (including system-in users and non-system-in users) as a whole. The viewing scene includes a presentation scene, a visiting exhibition scene, etc.

[0129] The presentation scene refers to a scene in which a display device is used to present display content for viewing, such as a scene in which a display device is used to show the appearance of a new product.

[0130] The presentation scene refers to a scene in which a display device is used to present display content for viewing, such as a scene in which a display device is used to show the appearance of a new product.

[0131] In some embodiments, the processing device 110 or the mode determining module 250 can determine the viewing scene based on the viewing positions of the in-system users and the viewing positions of the non-in-system users.

[0132] In some embodiments, in response to the viewing positions of the in-system users being located in the central region of the viewing positions of the non-in-system users, the processing device 110 or the mode determining module 250 determines the viewing scene to be the presentation scene.

[0133] The viewing positions of the in-system users being located in the central region of the viewing positions of the non-in-system users refers to at least one in-system user being present in the region surrounded by the non-in-system users.

[0134] Figure 5A FIG. 1 is a schematic diagram of user viewing positions according to some embodiments of the present specification.

[0135] For example, as shown in FIG. 1, at least one in-system user (including in-system users 511 and 512) is present in the region surrounded by a plurality of non-in-system users (including non-in-system users 521, 522, 523, 524, 525, 526, 527, and 528), and the processing device 110 or the mode determining module 250 can determine the viewing scene to be the presentation scene. Figure 5A

[0136] In some embodiments, the processing device 110 or the mode determining module 250 can determine, for each non-in-system user, a position feature count of the non-in-system user; and in response to the position feature counts of all non-in-system users being greater than zero, determine the viewing scene to be the presentation scene.

[0137] The position feature count refers to the number of in-system users whose viewing positions are adjacent to the viewing position of a non-in-system user. For example, if the viewing positions of three in-system users are adjacent to the viewing position of a non-in-system user, the position feature count of the non-in-system user is three.

[0138] Figure 5B FIG. 2 is a schematic diagram of user viewing positions according to some other embodiments of the present specification.

[0139] For example, as shown in FIG. 2, at least one in-system user (including in-system users 511 and 512) is present in the region surrounded by a plurality of non-in-system users (including non-in-system users 521, 522, 523, 524, 525, 526, 527, and 528), and the processing device 110 or the mode determining module 250 can determine the viewing scene to be the presentation scene. Figure 5B ​As shown, there are four non-system-in users in total, namely non-system-in users 541, 542, 543 and 544, wherein the system-in users adjacent to the viewing position of the non-system-in user 541 include the system-in users 531, 532 and 535, the system-in users adjacent to the viewing position of the non-system-in user 542 include the system-in users 533 and 537, the system-in users adjacent to the viewing position of the non-system-in user 543 include the system-in users 533, 536, 537 and 5310, and the system-in users adjacent to the viewing position of the non-system-in user 544 include the system-in users 534, 538 and 539, so that the position feature counts of the non-system-in users 541, 542, 543 and 544 are 3, 2, 4 and 3 respectively (all greater than zero). At this time, the processing device 110 or the mode determination module 250 can determine that the viewing scene is a presentation scene.

[0140] In step 380, the display mode is adjusted based on the viewing scene.

[0141] In some embodiments, the storage device (for example, the storage device 130) can pre-store a corresponding relationship between the display mode and the viewing scene, and the processing device 110 or the mode determination module 250 can retrieve the above corresponding relationship from the storage device after determining the viewing scene, and determine the adjusted display mode based on the viewing scene and the corresponding relationship. For example, the presentation scene has a corresponding relationship with the main screen exclusive mode, and the processing device 110 or the mode determination module 250 can determine that the display mode needs to be adjusted to the main screen exclusive mode after determining that the viewing scene is the presentation scene.

[0142] In some embodiments, in response to the viewing position of the system-in user being located in the central region of the viewing position of the non-system-in user, the processing device 110 or the mode determination module 250 determines that the viewing scene is a presentation scene, and then the processing device 110 or the mode determination module 250 adjusts the display mode of the display device to the main screen exclusive mode, and controls the display interface of the display device to display the display content corresponding to the user category to which the system-in user located in the central region belongs.

[0143] Continuing to refer to Figure 5A , based on the user viewing positions shown in Figure 5A , the processing device 110 or the mode determination module 250 can determine that the viewing scene is a presentation scene, and at this time, the processing device 110 or the mode determination module 250 can further adjust the display mode of the display device to the main screen exclusive mode, and control the display interface of the display device to display the display content corresponding to the user category to which the system-in user located in the central region belongs (i.e., the user category to which the system-in users 511 and 512 belong).

[0144] In some embodiments, the processing device 110 or the mode determination module 250 can determine the location feature count of each non-system user respectively; in response to the location feature counts of all non-system users being greater than zero, it is determined that the viewing scene is a lecture and demonstration scene, and then the processing device 110 or the mode determination module 250 adjusts the display mode of the display device to the main screen exclusive mode, and controls the display interface of the display device to display the display content corresponding to the user category to which the system user located in the center area belongs.

[0145] Continue to refer to Figure 5B , combined with the above, the processing device 110 or the mode determination module 250 is based on Figure 5B The user viewing position shown can determine that the viewing scene is an explanation and demonstration scene. At this time, the processing device 110 or the mode determination module 250 can further adjust the display mode of the display device to the main screen exclusive mode, and control the display interface of the display device to display the display content corresponding to the user category of the system user (system users 531~5310) adjacent to the viewing position of the non-system user.

[0146] In some embodiments of this specification, the spatial position and positional relationship of users within the system and users outside the system are used to accurately identify the explanation and demonstration scene, and automatically switch the display mode to the main screen exclusive mode, thereby ensuring the user's viewing experience and eliminating the need for manual switching, saving labor costs.

[0147] In some embodiments of this specification, by determining the viewing scenario and dynamically adapting the optimal interface presentation strategy (display mode) according to the viewing scenario, the efficiency of information transmission can be improved, the user experience can be optimized, and the cost of manual switching can be reduced.

[0148] In some embodiments of the present specification, by introducing user categories and screen viewing information to dynamically calculate the viewing weight, the display mode of the display device can be made more convenient for high-weight users to view, so as to ensure that important information is accurately displayed to high-weight users, and to avoid important information not being well displayed due to the presence of secondary users; by setting three display modes (main screen exclusive mode, split-screen negotiation mode and main-sub screen mode), the main screen exclusive mode can be used to display the content of interest to users whose viewing weight is significantly higher than other users, and the split-screen negotiation mode can be used to display the relevant content to users with similar weights respectively, ensuring that different categories of roles efficiently obtain the required display content.

[0149] It should be noted that the above description of flow 300 is merely for example and illustration, and does not limit the scope of the present specification. Various modifications and changes can be made to flow 300 under the guidance of the present specification by those skilled in the art. However, these modifications and changes still fall within the scope of the present specification. For example, after performing step 310, steps 360 to 380 are performed first, and then steps 320 to 350 are performed. For another example, flow 300 can only include steps 310 to 350. For yet another example, flow 300 can only include step 310 and steps 360 to 380.

[0150] Figure 6 is an exemplary flow chart of determining a viewing weight according to some embodiments of the present specification. As shown in Figure 6 , flow 600 includes the following steps. In some embodiments, flow 600 can be performed by processing device 110 or weight determination module 240.

[0151] Step 610, for each user category, a preset weight corresponding to the user category is obtained.

[0152] More information about user categories and preset weights can be found in Figure 3 and related descriptions thereof.

[0153] Step 620, based on the preset weight and the number of users corresponding to the user category, a first coefficient corresponding to the user category is determined.

[0154] The number of users corresponding to the user category refers to the number of users in the system belonging to the user category.

[0155] In some embodiments, the first coefficient can be calculated based on the preset weight and the number of users corresponding to the user category.

[0156] In some embodiments, the calculation method of the first coefficient can be shown in the following formula (1):

[0157] (1)

[0158] wherein, is the first coefficient of the i-th user category, is a positive integer, is the number of user categories, is the first coefficient of the i-th user category, is the preset weight of the i-th user category, is the number of users of the i-th user category.

[0159] ​​​Step 630: Determine the second coefficient corresponding to the user category based on the screen viewing information of users in the system belonging to the user category and the preset weight corresponding to the user category. Figure 3 and its related descriptions.

[0160] The second coefficient is different from the first coefficient.

[0161] In some embodiments, the second coefficient may be calculated based on screen viewing information of users in the system belonging to a user category and a preset weight corresponding to the user category.

[0162] In some embodiments, the second coefficient may be calculated as shown in the following formula (2):

[0163] (2)

[0164] in, For the The second coefficient of the user category, For the User category ( is a positive integer, ) is the screen viewing information score of users in the system. The meanings of other parameters in formula (2) are the same as those in formula (1), and can be referred to formula (1).

[0165] The screen viewing information score refers to a score value determined based on the screen viewing information of users in the system.

[0166] In some embodiments, the processing device 110 or the weight determination module 240 determines the screen viewing information score corresponding to the screen viewing information of users in each system based on a vector matching method.

[0167] Specifically, a vector database can be configured in the storage device (e.g., the storage device 130), and a plurality of reference vectors and reference scores (e.g., 1, or 2, or 5, or 20, etc.) corresponding to each reference vector can be stored in the vector database. Each reference vector includes a plurality of elements, and the value of each element respectively represents whether the user is gazing at the display device (exemplarily, 1 represents gazing, and 0 represents not gazing), the distance relative to the display device when gazing at the display device, the direction relative to the display device when gazing at the display device (represented by the angle between the line of sight of the user in the system and the normal line of the display interface of the display device (a straight line perpendicular to the display interface of the display device)), and the time length of gazing at the display device. The reference score corresponding to the reference vector can be preset. Exemplarily, the reference vector can be (1, 3.1, 25, 15), which represents that the user in the system is currently gazing at the display device, the distance relative to the display device is 3.1 m, the direction of the line of sight relative to the display device is 25°, and the time length of gazing at the display device is 15 s.

[0168] The processing device 110 or the weight determination module 240 can respectively construct a feature vector corresponding to the screen viewing information of each user in the system based on the screen viewing information of the user. Similar to the reference vector, the feature vector includes a plurality of elements, and the value of each element respectively represents whether the user is gazing at the display device (exemplarily, 1 represents gazing, and 0 represents not gazing), the distance relative to the display device when gazing at the display device, the direction relative to the display device when gazing at the display device, and the time length of gazing at the display device. Exemplarily, the reference vector can be (1, 2.3, 10, 17), which represents that the user in the system is currently gazing at the display device, the distance relative to the display device is 2.3 m, the direction of the line of sight relative to the display device is 10°, and the time length of gazing at the display device is 17 s.

[0169] Further, the processing device 110 or the weight determination module 240 can respectively calculate the vector distance between each reference vector in the vector database and the feature vector, and take the reference score corresponding to the reference vector with the smallest vector distance as the screen viewing information score corresponding to the screen viewing information of the user in the system. For example, assuming that the feature vector corresponding to the screen viewing information of the user in the system is vector X, and after calculation, the reference vector with the smallest vector distance to vector X among each reference vector in the vector database is vector Y, and the reference score corresponding to vector Y is 7, then the screen viewing information score corresponding to the screen viewing information of the user in the system is 7. The calculation method of the vector distance can be Euclidean distance, Manhattan distance, Chebyshev distance, cosine similarity, etc., which is not limited here.

[0170] In some embodiments, the processing device 110 or the weight determination module 240 is configured with a score determination model to determine a viewing screen information score corresponding to the viewing screen information. The score determination model is a machine learning model, and the input of the score determination model includes the viewing screen information of the in-system users belonging to each user category, and the output includes the viewing screen information score corresponding to each in-system user. Wherein, the viewing screen information corresponding to multiple user categories can be input (such as grouped input) into the score determination model at the same time, or the viewing screen information corresponding to each user category is input into the score determination model respectively.

[0171] In some embodiments, the processing device 110 or the weight determination module 240 determines at least one intended user of the display device based on the viewing screen information for at least one in-system user.

[0172] The intended user refers to an in-system user who gazes at the display device within a preset time period. The preset time period refers to a period of time before the current time. The length of the preset time period can be preset, for example, 20s, 30s, 1min, etc.

[0173] For example, taking 30s as the preset time period, assuming that the viewing screen information of a certain in-system user at 25s before the current time reflects that the in-system user is gazing at the display device, the in-system user will be confirmed as an intended user. As another example, still taking 30s as the preset time period, assuming that the viewing screen information of a certain in-system user within 30s before the current time is all not gazing at the display device, the in-system user will not be determined as an intended user.

[0174] After determining the at least one intended user, the processing device 110 or the weight determination module 240 determines distance information and gazing time length of the display device for the at least one intended user based on the viewing screen information. The aforementioned distance information and gazing time length can be directly determined based on the viewing screen information of the at least one intended user. For more information about the viewing screen information, please refer to Figure 3 and the related description thereof.

[0175] In some embodiments, the processing device 110 or the weight determination module 240 respectively determines, for each user category, a second coefficient of the user category based on the distance information and the gazing time length of the intended user belonging to the user category.

[0176] In some embodiments, for each user category, the second coefficient can be calculated based on the distance information (characterizing the distance of the intended user relative to the display device) and the gazing time length of the intended user belonging to the user category, and a preset weight of the user category.

[0177] In some embodiments, the calculation method of the second coefficient can be shown in the following formula (3):

[0178] (3)

[0179] in, For the The second coefficient of the user category, For the The number of intended users in each user category, For the User category ( is a positive integer, ) The gaze duration of the intended user, For the The sum of the gaze durations of all intended users in a user category, is the distance attenuation coefficient (constant), For the User category The distance between the intended user and the display device, For the The preset weights for each user category.

[0180] Step 640: Determine the screen viewing weight corresponding to the user category based on the first coefficient and the second coefficient.

[0181] In some embodiments, the screen viewing weight corresponding to the user category can be calculated based on the first coefficient and the second coefficient.

[0182] In some embodiments, the method for calculating the screen viewing weight may be as shown in the following formula (4):

[0183] (4)

[0184] in, For the The viewing weight of each user category, and is the proportionality coefficient, and The meanings of other parameters in formula (4) are the same as those in formula (1) to formula (3), and can be referred to formula (1) to formula (3).

[0185] In some embodiments, the method for calculating the screen viewing weight may be as shown in the following formula (5):

[0186] (5)

[0187] The meanings of the parameters in formula (5) are the same as those in formula (1) to formula (4), and reference can be made to formula (1) to formula (4).

[0188] In some embodiments of the present specification, by determining different gaze weights for users of different user categories, it is ensured that high-weight users have priority in gaze, and the display device is prevented from being disturbed by a large number of low-weight user groups in the display of key information; the actual use of the gaze weight is determined based on the gaze duration and the distance when the display device is gazed at, which reduces the contribution of long-distance or short-gaze users to the weight, and makes the determined gaze weight more reasonable.

[0189] Figure 7 is an exemplary flowchart of determining a display mode according to some embodiments of the present specification. As shown in Figure 7 , the flow 700 includes the following steps. In some embodiments, the flow 700 can be performed by the processing device 110 or the mode determination module 250.

[0190] Step 710, sort the gaze weights corresponding to all user categories from large to small to obtain a sorting result.

[0191] Step 720, based on the sorting result, determine whether the numerical relationship satisfies a first preset condition.

[0192] The above numerical relationship refers to the numerical relationship of the gaze weights corresponding to each user category. In combination with the foregoing, the numerical relationship of the gaze weights corresponding to each user category refers to the mathematical relationship of the gaze weight values corresponding to each user category, such as the size relationship, the proportion relationship, the multiple relationship, etc.

[0193] The first preset condition includes that the first gaze weight is not less than a preset multiple (for example, 2 times or 3 times or 5 times, etc.) of the median gaze weight, or the first gaze weight is greater than half of the sum of the gaze weights. The first gaze weight is the gaze weight located in the first place in the sorting result (i.e., the maximum value in all gaze weights). The median gaze weight is the median of the gaze weights corresponding to each user category. The sum of the gaze weights is the sum of the gaze weights corresponding to all user categories. For example, taking 5 user categories and a preset multiple of 2 times as an example, the gaze weights corresponding to the 5 user categories are 2, 10, 3, 4, and 7, respectively, and the sorting result from large to small is 10-7-4-3-2, then the first gaze weight is 10, the median gaze weight is 4, and the first gaze weight is greater than the preset multiple of the median gaze weight (10>4x2), so the numerical relationship satisfies the first preset condition. For another example, taking 5 user categories as an example, the gaze weights corresponding to the 5 user categories are 2, 15, 1, 4, and 6, respectively, and the sorting result from large to small is 15-6-4-2-1, then the first gaze weight is 15, the sum of the gaze weights is 15+6+4+2+1=28, and the first gaze weight is greater than half of the sum of the gaze weights (15>28 / 2), so the numerical relationship satisfies the first preset condition.

[0194] Step 730, in response to the numerical relationship satisfying the first preset condition, determining that the display mode is a main screen exclusive mode; in response to the numerical relationship not satisfying the first preset condition, entering step 740.

[0195] In some embodiments, in response to the display mode being the main screen exclusive mode, the processing device 110 or the mode determining module 250 controls the display interface of the display device to display only the display content corresponding to the user category corresponding to the first viewing screen weight.

[0196] For example, as shown in FIG. 4, the processing device 110 or the mode determining module 250 controls the display interface 400 of the display device to display only the display content corresponding to the user category corresponding to the first viewing screen weight. Figure 4A For example, assuming that the user category corresponding to the first viewing screen weight is the director category, the processing device 110 or the mode determining module 250 controls the display interface 400 of the display device to display only the display content corresponding to the director category user (e.g., pictures or reports expected to be viewed by the director category user, etc.).

[0197] Step 740, determining whether the numerical relationship satisfies a second preset condition.

[0198] The second preset condition includes that the first weight sum is not less than a preset multiple of the median viewing screen weight, or the first weight sum is greater than half of the total viewing screen weight. The first weight sum is the sum of the first viewing screen weight and the second viewing screen weight. The second viewing screen weight is the viewing screen weight in the second place in the above-mentioned descending order result (i.e., the second largest viewing screen weight in all viewing screen weights). For example, taking 5 user categories and a preset multiple of 3 times as an example, the viewing screen weights corresponding to the 5 user categories are 5, 1, 3, 8, and 4, respectively, the descending order result is 8-5-4-3-1, the first viewing screen weight is 8, the second viewing screen weight is 5, the first weight sum is 8+5=13, the median viewing screen weight is 4, and the first weight sum is greater than the preset multiple of the median viewing screen weight (13>4x3), so the numerical relationship satisfies the second preset condition. For another example, taking 5 user categories as an example, the viewing screen weights corresponding to the 5 user categories are 2, 9, 1, 4, and 6, respectively, the descending order result is 9-6-4-2-1, the first viewing screen weight is 9, the second viewing screen weight is 6, the first weight sum is 9+6=15, the total viewing screen weight is 9+6+4+2+1=22, and the first weight sum is greater than half of the total viewing screen weight (15>22 / 2), so the numerical relationship satisfies the second preset condition.

[0199] Step 750, in response to the numerical relationship satisfying the second preset condition, determining that the display mode is a split screen negotiation mode; in response to the numerical relationship not satisfying the second preset condition, entering step 760.

[0200] In some embodiments, in response to the display mode being the split-screen negotiation mode, the processing device 110 or the mode determining module 250 divides the display interface of the display device into a first display region and a second display region.

[0201] For example, as shown in FIG. 4, Figure 4B In response to the display mode being the split-screen negotiation mode, the processing device 110 or the mode determining module 250 divides the display interface 400 of the display device into a first display region 421 and a second display region 422.

[0202] In some embodiments, the processing device 110 or the mode determining module 250 divides the display interface of the display device into a first display region and a second display region based on the first viewing weight and the second viewing weight. In some embodiments, the area ratio of the first display region and the second display region is determined based on the ratio of the first viewing weight and the second viewing weight. For example, if the ratio of the first viewing weight and the second viewing weight is 3:2, the area ratio of the first display region and the second display region is also 3:2.

[0203] In some embodiments, when the display mode is the split-screen negotiation mode, the processing device 110 or the mode determining module 250 controls the first display region to display display content corresponding to a user category corresponding to the first viewing weight, and controls the second display region to display display content corresponding to a user category corresponding to the second viewing weight.

[0204] For example, as shown in FIG. 4, Figure 4B The processing device 110 or the mode determining module 250 controls the first display region 421 to display display content corresponding to a user category corresponding to the first viewing weight, and controls the second display region 422 to display display content corresponding to a user category corresponding to the second viewing weight. For example, assuming that the user category corresponding to the first viewing weight is the director category, and the user category corresponding to the second viewing weight is the executive category, the processing device 110 or the mode determining module 250 controls the first display region 421 of the display device to display display content (for example, pictures or reports expected to be viewed by the director category user) corresponding to the director category user, and controls the second display region 422 of the display device to display display content (for example, pictures or videos expected to be viewed by the executive category user) corresponding to the executive category user.

[0205] Step 760: determining whether the numerical relationship satisfies a third preset condition.

[0206] The second preset condition includes that the second weight sum is not less than a preset multiple of the median screen watching weight, or the second weight sum is greater than half of the total screen watching weight. The second weight sum is the sum of the first screen watching weight, the second screen watching weight, and the third screen watching weight. The third screen watching weight is the screen watching weight in the third position in the above-mentioned sorting result from large to small (i.e., the third largest screen watching weight in all screen watching weights). For example, taking the case that there are 5 user categories in total and the preset multiple is 3 times as an example, the screen watching weights corresponding to the 5 user categories are 5, 1, 3, 6, and 4 respectively, the sorting result is 6-5-4-3-1, the first screen watching weight is 6, the second screen watching weight is 5, the third screen watching weight is 4, the second weight sum is 6+5+4=15, the median screen watching weight is 4, and the second weight sum is greater than the preset multiple of the median screen watching weight (15>4x3), so the numerical relationship satisfies the third preset condition. For another example, taking the case that there are 7 user categories in total as an example, the screen watching weights corresponding to the 7 user categories are 2, 7, 1, 4, 5, 3, and 8 respectively, the sorting result is 8-7-5-4-3-2-1, the first screen watching weight is 8, the second screen watching weight is 7, the third screen watching weight is 5, the second weight sum is 8+7+5=20, the total screen watching weight is 8+7+5+4+3+2+1=30, and the first weight sum is greater than half of the total screen watching weight (20>30 / 2), so the numerical relationship satisfies the third preset condition.

[0207] In step 770, in response to the numerical relationship satisfying the third preset condition, it is determined that the display mode is the main-sub screen mode.

[0208] In some embodiments, in response to the display mode being the main-sub screen mode, the processing device 110 or the mode determination module 250 can determine a plurality of shortlisted user categories.

[0209] The multiple shortlisted user categories are user categories corresponding to the top N viewing weights in the aforementioned sorting results. The multiple shortlisted user categories include at least one main user category and at least one secondary user category. The main user category is the user category corresponding to the top M viewing weights in the sorting results, and the secondary user category is the user category other than the main user category in the multiple shortlisted user categories, where N and M are both positive integers, and N>M≥1. For example, taking N=3 and M=1 as an example, the multiple shortlisted user categories are user categories corresponding to the top 3 viewing weights in the sorting results, the main user category is the user category corresponding to the top 1 viewing weight (first viewing weight) in the sorting results, and the secondary user category is the user category corresponding to the 2 viewing weights that are ranked 2nd (second viewing weight) and 3rd (third viewing weight) in the sorting results. For another example, taking N=5 and M=2, the multiple shortlisted user categories are the user categories corresponding to the top 5 viewing weights in the sorting results, the main user category is the user category corresponding to the top 2 viewing weights (the first viewing weight and the second viewing weight) in the sorting results, and the secondary user category is the user category corresponding to the 3 viewing weights ranked from the 3rd (third viewing weight) to the 5th in the sorting results.

[0210] In some embodiments, when the display mode is primary / secondary screen mode, the display interface of the display device is divided into multiple display areas. The multiple display areas include at least one primary display area and at least one secondary display area. The number of the at least one primary display area is equal to the number of the at least one primary user category, and the number of the at least one secondary display area is equal to the number of the at least one secondary user category.

[0211] For example, Figure 4C As shown, in response to the display mode being the main-sub-screen mode, taking the number of main user categories as 1 and the number of sub-user categories as 2 as an example, the processing device 110 or the mode determination module 250 divides the display interface 400 of the display device into a main display area (i.e., the main display area 431) and two sub-display areas (including sub-display area 432 and sub-display area 433).

[0212] In some embodiments, the area of ​​the primary display region is larger than the area of ​​the secondary display region. Figure 4C As shown, the area of ​​the main display area 431 is larger than the areas of the auxiliary display area 432 and the auxiliary display area 433.

[0213] In some embodiments, when the display mode is the primary-secondary screen mode, the area ratio of each display area is determined based on the ratio of the viewing weight of each display area. Figure 4CAs shown, assuming that the ratio of the screen viewing weights corresponding to the main display area 431, the secondary display area 432 and the secondary display area 433 is 6:3:2, the ratio of the areas of the main display area 431, the secondary display area 432 and the secondary display area 433 is 6:3:2.

[0214] In some embodiments, in response to the display mode being the main-secondary screen mode, the processing device 110 or the mode determining module 250 controls the at least one main display area to display the display content corresponding to the at least one main user category respectively, and controls the at least one secondary display area to display the display content corresponding to the at least one secondary user category respectively.

[0215] Exemplarily, as shown in FIG. 4, the processing device 110 or the mode determining module 250 controls the main display area 431 to display the display content corresponding to the user category corresponding to the first screen viewing weight, controls the secondary display area 432 to display the display content corresponding to the user category corresponding to the second screen viewing weight, and controls the secondary display area 433 to display the display content corresponding to the user category corresponding to the third screen viewing weight. For example, assuming that the user category corresponding to the first screen viewing weight is the director category, the user category corresponding to the second screen viewing weight is the senior manager category, and the user category corresponding to the third screen viewing weight is the employee category, the processing device 110 or the mode determining module 250 controls the main display area 431 of the display device to display the display content (e.g., pictures or reports expected to be viewed by the director category users, etc.) corresponding to the director category users, controls the secondary display area 432 of the display device to display the display content (e.g., pictures or videos expected to be viewed by the senior manager category users, etc.) corresponding to the senior manager category users, and controls the secondary display area 433 of the display device to display the display content (e.g., pictures or videos expected to be viewed by the employee category users, etc.) corresponding to the employee category users. Figure 4C

[0216] In some embodiments of the present specification, by the above-mentioned method of determining the display mode of the display device, the viewing experience of important users (users in the user category with larger screen viewing weights) is better guaranteed while the viewing needs of all users are taken into account.

[0217] In some embodiments, the flow 700 further includes the following steps 780 and 790.

[0218] Step 780: determining the plurality of legal users based on the display mode in which the display device is currently located.

[0219] ​A legal user refers to a user in a user category corresponding to the display content currently displayed by the display device. For example, in the case that the display mode is the main screen exclusive mode and the display content is the display content corresponding to the director user, the legal user is the user in the director category. For another example, in the case that the display mode is the split screen negotiation mode and the display content is the display content corresponding to the director user and the executive user, the legal user is the user in the director category and the executive category.

[0220] At step 790, the display module to be zoomed in is determined based on the screen viewing information of the plurality of legal users.

[0221] A display module refers to a module in the display interface of the display device, which is used to display the display content corresponding to a user category. For example, the display module can be a component in a building information model (BIM), a specific data area in a data board, a picture in a plurality of pictures, etc.

[0222] A display area (e.g., a first display area, a second display area, a main display area, a secondary display area) can include one or more display modules. A display module can independently present at least part of the display content of the display area to which it belongs in the display interface, and the display content presented by each display module is not repeated. For example, in the case that a display area includes three display modules and the display content of the display area includes six pictures, the three display modules can present two pictures in the six pictures respectively, or the three display modules present one, two or three pictures in the six pictures respectively.

[0223] The display module to be zoomed in refers to the display module determined from all the display modules included in the display interface of the display device, which can be zoomed in and displayed subsequently. In some embodiments, the processing device 110 or the mode determination module 250 can determine a target display module from the display module to be zoomed in and zoom in the target display module. More details about the determination method of the target display module are described below.

[0224] The zooming in described above refers to expanding the area of the display module in the display interface while expanding the area of the display content in the display module at the same ratio. For example, if the area of the display module is expanded to twice the original area, the area of the picture or video included in the display module is also expanded to twice the original area.

[0225] There can be various forms of magnifying the display module. For example, the target display module is to be magnified, and the areas of other display modules that are not to be magnified are reduced to make room for the target display module in the display interface. For another example, a new display region (for example, across the split-screen region) is created in the display interface, the new display region is suspended above other display regions, and the target display module is displayed in the new display region after being magnified (in this form, the areas of the original display regions and the display content therein remain unchanged, and the new display region can block the display content in the original display regions to some extent). More information about the split-screen region can be found in the following description. The display module can also be magnified in other forms, which are not limited herein.

[0226] In some embodiments, the screen viewing information further includes whether each display module in each display region is gazed at by the user in the system and the gazing duration.

[0227] In some embodiments, the processing device 110 or the mode determination module 250 can determine whether the user in the system is gazing at the display device based on the eye movement trajectory information in the image information. For example, the processing device 110 or the mode determination module 250 can determine the line-of-sight landing point in the eye movement trajectory based on the time point at which the image information is obtained, and if the line-of-sight landing point is located in a certain display module, it is determined that the user in the system is gazing at the display module.

[0228] In some embodiments, the duration of gazing at the display module can be determined based on the number of times the user in the system is continuously determined to be gazing at the display module. For example, taking the frequency of obtaining image information (containing eye movement trajectory information) by the image acquisition device as 60 times per minute (i.e., once per second) as an example (it can be understood that each time image information is obtained, it is determined whether the user in the system is gazing at a certain display module), if a user in the system is determined to be gazing at a certain display module based on the latest obtained eye movement trajectory information, and has been determined to be gazing at the display module for 10 times before this determination, the duration of the user in the system gazing at the display module is 10+1=11 seconds.

[0229] In some embodiments, the processing device 110 or the mode determination module 250 can determine, for each display module, whether the total gazing duration of the display module satisfies a fourth preset condition; and in response to the fourth preset condition being satisfied, determine that the display module is a display module to be magnified.

[0230] The total gazing duration refers to the sum of the durations of all legitimate users gazing at the display module.

[0231] The fourth preset condition includes that the total gazing duration is greater than a preset duration threshold, for example, 2 minutes, 3 minutes, or 5 minutes, etc.

[0232] In some embodiments, when the display device is in the split-screen negotiation mode, in response to the existence of the display module to be enlarged in both the first display region and the second display region, the processing device 110 or the mode determination module 250 determines the conflict arbitration score of the first user category and the second user category based on the user level and the line-of-sight projection angle of each legitimate user in the first user category and the second user category, and the business importance of the display module to be enlarged. The first user category is the user category corresponding to the display content of the first display region, and the second user category is the user category corresponding to the display content of the second display region.

[0233] The user level reflects the importance of the user in the system.

[0234] The user level is positively correlated with the job level of the user in the system, that is, the higher the job level of the user in the system, the higher the user level. For example, the user level of the chairman is higher than that of the general manager, the user level of the general manager is higher than that of the department manager, and so on. The user level can be represented by a user level score, and the higher the user level, the higher the user level score. For example, the user level score of the chairman is 10, the user level score of the director is 9, the user level score of the general manager is 8, and so on.

[0235] The line-of-sight projection angle refers to the angle between the user's line of sight and the normal line (a straight line perpendicular to the display interface of the display device) of the display module. The line-of-sight projection angle can be determined based on the screen viewing information of the user in the system, for example, based on the distance and direction of the user in the system relative to the display device, the landing point of the eye movement trajectory on the display device, and the position (coordinates) of the display module on the display interface of the display device.

[0236] The business importance of the display module to be enlarged reflects the degree of relevance to the main business of the enterprise. The higher the business importance, the higher the degree of relevance of the display content in the display module to be enlarged to the main business of the enterprise. For example, taking a construction enterprise as an example, the display module in which the display content related to construction progress, construction budget, and construction safety has a higher business importance, and the business importance of other display modules is lower.

[0237] In some embodiments, the business importance of the display module to be enlarged is represented by a business importance score, and the higher the business importance score, the higher the business importance.

[0238] In some embodiments, the business importance of the display module to be enlarged can be binary, that is, the business importance score of the display module to be enlarged with higher business importance (for example, the display module in which the display content related to construction progress, construction budget, and construction safety of the construction enterprise described in the foregoing example) is set to 1, and the business importance score of the display module to be enlarged with lower business importance is set to 0.

[0239] The conflict arbitration score reflects the zoom priority of the display module to be zoomed. In the first user category and the second user category, the display module to be zoomed in the display area corresponding to the user with a higher conflict arbitration score is zoomed in preferentially.

[0240] In some embodiments, the conflict arbitration score is calculated based on the user level and the line-of-sight projection angle of the user in each system, and the service importance of the display module to be zoomed.

[0241] In some embodiments, the calculation method of the conflict arbitration score can be shown in the following formula (6):

[0242] (6)

[0243] wherein, is the conflict arbitration score of the first user category or the second user category (C1 or C2), = 1 or 2, = 1 corresponds to the first user category, = 2 corresponds to the second user category, and the same below, is the number of legitimate users belonging to the first user category or the second user category, is the user level score of the i-th legitimate user in the first user category or the second user category, (0 < i < N1 or N2), is a positive integer, is the service importance score of the display module to be zoomed in the first display area or the second display area (D1 or D2), = 1 corresponds to the first display area, = 2 corresponds to the second display area, is the natural logarithm, is the user level related decay rate (constant), is the gaze duration of the i-th legitimate user in the first user category or the second user category to the display module to be zoomed, is the line-of-sight angle compensation coefficient (constant), is the vector representing the line-of-sight direction of the i-th legitimate user in the first user category or the second user category, is the normal vector of the display device.

[0244] ​​​In some embodiments, when the display device is in the split-screen negotiation mode, the processing device 110 or the mode determining module 250 determines a target display module based on the conflict arbitration score and displays the target display module in an enlarged manner across a split-screen region. For example, the display module in the display region corresponding to the user category with a larger conflict arbitration score is determined as the target display module. The split-screen region refers to a partial region in the display interface that spans at least two display regions. For example Figure 4B the split-screen region 423 spanning the first display region 421 and the second display region 422, or Figure 4C the split-screen region 434 spanning the main display region 431 and the auxiliary display region 432, 433. The enlarged display refers to expanding the area of the target display module, with the display content in the target display module being expanded proportionally.

[0245] Exemplarily, if the conflict arbitration score of the first user category is larger than that of the second user category, the display module in the first display region is determined as the target display module, and the target display module is displayed in an enlarged manner across the split-screen region. In this embodiment, the display content of the split-screen region 423 is displayed on top of the display content of the first display region 421 and the display content of the second display region 422, i.e., the display content corresponding to the split-screen region 423 is located at the topmost layer.

[0246] In some embodiments, when the display device is in the main-auxiliary screen mode, in response to the presence of a display module to be enlarged in the main display region, the processing device 110 or the mode determining module 250 determines the display module to be enlarged in the main display region as the target display module and displays the target display module in an enlarged manner in the main display region or across a split-screen region.

[0247] Exemplarily, as Figure 4C shown, if there is a display module to be enlarged in the main display region 431, the display module to be enlarged is determined as the target display module, and the target display module is displayed in an enlarged manner in the main display region 431 or across the split-screen region 434.

[0248] In some embodiments, when the display device is in the main-auxiliary screen mode, in response to the presence of a display module to be enlarged in the auxiliary display region and the absence of a display module to be enlarged in the main display region, the processing device 110 or the mode determining module 250 determines the display module to be enlarged in the auxiliary display region as the target display module and displays the target display module in an enlarged manner in the main display region or across a split-screen region.

[0249] Exemplarily, as Figure 4CAs shown, if there is a display module to be zoomed in the sub-display area 432 and there is no display module to be zoomed in the main display area 431, the display module to be zoomed in is determined as the target display module, and the target display module is zoomed in in the main display area 431 or across the split-screen area 434.

[0250] In some embodiments of the present specification, the user's viewing experience is optimized by zooming in the display module; when various users simultaneously compete for display resources (e.g., various users want to zoom in the display content corresponding to each user), the rationality of the display module zooming strategy and display resource allocation is improved by determining the target display module and zooming in the target display module.

[0251] The above has described the basic concept, and it is obvious that the above detailed disclosure is only used as an example and does not limit the present specification for those skilled in the art. Although it is not explicitly stated here, those skilled in the art can make various modifications, improvements and corrections to the present specification. Such modifications, improvements and corrections are suggested in the present specification, so such modifications, improvements and corrections still belong to the spirit and scope of the exemplary embodiments of the present specification.

[0252] Meanwhile, specific words are used in the present specification to describe the embodiments of the present specification. As "one embodiment", "an embodiment", and / or "some embodiments" means a certain feature, structure or characteristic related to at least one embodiment of the present specification. Therefore, it should be emphasized and noted that "an embodiment" or "one embodiment" or "one alternative embodiment" mentioned in different places in the present specification does not necessarily mean the same embodiment. In addition, some features, structures or characteristics in one or more embodiments of the present specification can be properly combined.

[0253] In addition, unless the claim explicitly states, the order of the processing elements and sequences described in the present specification, the use of numerals and letters, or the use of other names, is not intended to limit the order of the processes and methods of the present specification. Although some currently considered useful embodiments of the invention are discussed in the above disclosure through various examples, it should be understood that such details are only for the purpose of illustration, and the additional claims are not limited to the disclosed embodiments, on the contrary, the claims are intended to cover all modifications and equivalent combinations that meet the spirit and scope of the embodiments of the present specification. For example, although the system components described above can be realized by hardware devices, they can also be realized by only software solutions, such as installing the described system on existing servers or mobile devices.

[0254] For simplicity and to facilitate understanding of one or more embodiments, a description of an embodiment sometimes refers to a plurality of features in a single embodiment, drawing, or description of an embodiment. However, this method of disclosure is not to be interpreted as meaning that the claimed embodiment requires more features than are explicitly recited in the claims. In fact, claims that do not specifically claim a combination of features are intended to cover the various possible combinations of features as would be understood by a person of ordinary skill in the art.

[0255] Some embodiments use numerical values to describe components, quantities of attributes. It should be understood that such numerical values used in the description of embodiments are, in some examples, modified by the adjectives "about," "approximately," or "substantially." Unless otherwise stated, "about," "approximately," or "substantially" indicate that the described numerical value allows for a variation of ±20%. Accordingly, numerical values used in the specification and claims of some embodiments are approximations that can vary depending on the desired characteristics of the individual embodiments. In some embodiments, numerical values used in the specification and claims are approximations that can vary depending on the desired characteristics of the individual embodiments. In some embodiments, numerical values should be considered in the context of the number of significant digits used in the number and the accepted bits of precision of the number. Although the numerical ranges and parameters setting forth the broadest scope of some embodiments of the specification are approximations, the numerical values set forth in the specific examples are reported as precisely as reasonably possible. The application is not limited to the specific numerical values set forth in the examples.

[0256] Each patent, patent application, patent publication, and other material, such as articles, books, specifications, publications, documents, and the like, referenced herein are hereby incorporated by reference in their entirety for the teachings relevant to the sentence and / or paragraph in which the reference is made. Discrepancies between document file histories and the contents of the present specification, including the claims, shall be resolved in favor of the contents of the present specification, including the claims. It is specifically intended that the description, definitions, and / or terminology used herein be interpreted in only its broadest possible manner consistent with the principles of patent law, and not in the preferred, specialized, or more limited sense, if any, that can be suggested by normal use of such words and expressions by those with ordinary skill in the art.

[0257] Finally, it should be understood that the embodiments described herein are merely exemplary of the principles of the application. Other variations having essentially the same structure and function but different implementation details are within the scope of the application. Accordingly, the embodiments described herein are not limited to that precisely as shown and described.

Claims

1. A display control method, characterized in that: include: Acquiring image information of one or more users within a preset area of ​​a display device; Determine, based on the image information, at least one in-system user among the one or more users, identity information of each in-system user, and screen viewing information of each in-system user on the display device; Determining a user category to which each user in the system belongs based on the identity information, wherein the number of the user categories is multiple, and each user category includes one or more users in the system; For each user category, determining a screen viewing weight corresponding to the user category based on the user category and the screen viewing information of users in the system belonging to the user category; as well as Based on the numerical relationship between the screen viewing weights corresponding to each of the user categories, the display mode of the display device is determined, and the display mode includes a main screen exclusive mode, a split screen negotiation mode and a main and sub-screen mode.

2. The method according to claim 1, characterized in that The determining, based on the user category and the screen viewing information of the users in the system belonging to the user category, of a screen viewing weight corresponding to each user category includes: For each of the user categories, Get the preset weight corresponding to the user category; Determining a first coefficient corresponding to the user category based on the preset weight corresponding to the user category and the number of users; determining, based on the screen viewing information of users in the system belonging to the user category and the preset weight corresponding to the user category, a second coefficient corresponding to the user category, where the first coefficient and the second coefficient are different coefficients; The screen viewing weight corresponding to the user category is determined based on the first coefficient and the second coefficient.

3. The method according to claim 2, characterized in that The determining, based on the screen viewing information of users in the system belonging to the user category and the preset weight corresponding to the user category, a second coefficient corresponding to the user category includes: For the at least one user within the system, determining at least one intended user to view the display device based on the screen viewing information; Determining distance information and gaze duration of the at least one intended user relative to the display device based on the screen viewing information; For each user category, the second coefficient of the user category is determined based on the distance information and the gaze duration of the intended users belonging to the user category.

4. The method according to claim 1, wherein The determining the display mode of the display device based on the numerical relationship between the screen viewing weights corresponding to the user categories includes: Sort the screen viewing weights corresponding to all the user categories from large to small to obtain a sorting result; Based on the sorting result, it is determined whether the numerical relationship meets a first preset condition, In response to the numerical relationship satisfying the first preset condition, determining that the display mode is the main screen exclusive mode; the first preset condition includes that the first viewing weight is not less than a preset multiple of the median viewing weight, or that the first viewing weight is greater than half of the total viewing weights, wherein the first viewing weight is the viewing weight ranked first in the sorting result, the median viewing weight is the median of the viewing weights corresponding to each of the user categories, and the total viewing weight is the sum of the viewing weights corresponding to all the user categories; In response to the numerical relationship not satisfying the first preset condition, determining whether the numerical relationship satisfies a second preset condition, In response to the numerical relationship satisfying the second preset condition, determining that the display mode is the split-screen negotiation mode; the second preset condition includes that the first weight sum is not less than a preset multiple of the median viewing weight, or the first weight sum is greater than half of the sum of the viewing weights, wherein the first weight sum is the sum of the first viewing weight and the second viewing weight, and the second viewing weight is the viewing weight ranked second in the sorting result; In response to the numerical relationship not satisfying the second preset condition, determining whether the numerical relationship satisfies a third preset condition, In response to the numerical relationship satisfying the third preset condition, the display mode is determined to be the main-sub-screen mode, and the third preset condition includes that the sum of the second weights is not less than a preset multiple of the median viewing weight, or the sum of the second weights is greater than half of the total viewing weights, and the sum of the second weights is the sum of the first viewing weight, the second viewing weight and the third viewing weight, wherein the third viewing weight is the viewing weight ranked third in the sorting result.

5. The method according to claim 4, characterized in that Determining the display mode of the display device further includes: In response to the display mode being the main screen exclusive mode, the display interface of the display device is controlled to only display the display content corresponding to the user category corresponding to the first screen viewing weight.

6. The method according to claim 4, characterized in that Determining the display mode of the display device further includes: In response to the display mode being the split-screen negotiation mode, the display interface of the display device is divided into a first display area and a second display area, and the ratio of the areas of the first display area and the second display area is determined based on the ratio of the first viewing screen weight to the second viewing screen weight.

7. The method according to claim 6, characterized in that Determining the display mode of the display device further includes: Controlling the first display area to display display content corresponding to the user category corresponding to the first screen viewing weight; The second display area is controlled to display the display content corresponding to the user category corresponding to the second screen viewing weight.

8. The method according to claim 4, characterized in that Determining the display mode of the display device further includes: In response to the display mode being the primary-secondary screen mode, determining a plurality of shortlisted user categories, the plurality of shortlisted user categories being user categories corresponding to the top N viewing weights in the sorting result, the plurality of shortlisted user categories including at least one primary user category and at least one secondary user category, the primary user category being the user category corresponding to the top M viewing weights in the sorting result, and the secondary user category being the user category other than the primary user category in the plurality of shortlisted user categories, wherein N and M are both positive integers, and N>M≥1; Dividing a display interface of the display device into a plurality of display areas, wherein the plurality of display areas include at least one main display area and at least one secondary display area, wherein the number of the at least one main display area is equal to the number of the at least one main user category, and the number of the at least one secondary display area is equal to the number of the at least one secondary user category, and the area of ​​the main display area is larger than the area of ​​the secondary display area; The at least one main display area is controlled to display display content corresponding to the at least one main user category, and the at least one secondary display area is controlled to display the display content corresponding to the at least one secondary user category.

9. The method according to any one of claims 5 to 8, characterized in that Also includes: determining a plurality of legitimate users based on the display mode currently in which the display device is located, wherein the legitimate users include system users in the user category corresponding to the display content currently displayed by the display device; Based on the screen viewing information of the multiple legitimate users, a display module to be enlarged is determined, where the display module is a module in the display interface of the display device, used to display the display content corresponding to the user category.

10. The method according to claim 9, characterized in that The determining the display module to be magnified based on the screen viewing information of the multiple legitimate users includes: When the display device is in the split-screen negotiation mode, In response to the presence of the display module to be enlarged in both the first display area and the second display area, determining a conflict arbitration score for the first user category and the second user category based on the user level and sight projection angle of each of the legitimate users in the first user category and the second user category, and the service importance of the display module to be enlarged, wherein the first user category is the user category corresponding to the display content of the first display area, and the second user category is the user category corresponding to the display content of the second display area; Based on the conflict arbitration score, a target display module is determined, and the target display module is magnified and displayed in the cross-split screen area.

11. The method according to claim 9, characterized in that The determining the display module to be magnified based on the screen viewing information of the multiple legitimate users includes: When the display device is in the main-slave screen mode, In response to the presence of the display module to be enlarged in the main display area, determining the display module to be enlarged in the main display area as a target display module, and displaying the target display module in an enlarged manner in the main display area or across the split-screen area; In response to the presence of the display module to be enlarged in the secondary display area and the absence of the display module to be enlarged in the main display area, the display module to be enlarged in the secondary display area is determined as the target display module, and the target display module is enlarged and displayed in the main display area or the cross-split screen area.

12. The method according to claim 1, characterized in that Also includes: Determining at least one non-system user and screen viewing information of each non-system user from the one or more users based on the image information; determining a screen viewing scene based on the user category to which the at least one in-system user belongs and the screen viewing information, and the screen viewing information of the at least one non-system user; The screen viewing scenes include explanation and demonstration scenes and visiting and displaying scenes; Based on the screen viewing scenario, the display mode is adjusted.

13. The method according to claim 12, characterized in that The determining of the screen viewing scene includes: In response to the screen viewing position of the user in the system being located in the center area of ​​the screen viewing position of the non-user in the system, Determining that the screen viewing scene is the explanation and demonstration scene; The display mode of the display device is adjusted to the main screen exclusive mode, and the display interface of the display device is controlled to display the display content corresponding to the user category to which the user in the system located in the central area belongs.

14. The method according to claim 12, characterized in that The determining of the screen viewing scene includes: For each of the non-system users, determining a location feature count of the non-system user, the location feature count being the number of system users whose viewing positions are adjacent to the viewing position of the non-system user; and In response to the location feature counts of all the non-system users being greater than zero, Determining that the screen viewing scene is the explanation and demonstration scene; and The display mode of the display device is adjusted to the main screen exclusive mode, and the display interface of the display device is controlled to display the display content corresponding to the user category to which the system user who is adjacent to the viewing position of the non-system user belongs.

15. A display control system, characterized in that: include: An acquisition module, configured to acquire image information of one or more users within a preset area of ​​the display device; a user determination module configured to determine, based on the image information, at least one in-system user among the one or more users, identity information of each in-system user, and screen viewing information of each in-system user on the display device; a category determination module, configured to determine, based on the identity information, a user category to which each user in the system belongs, wherein the number of the user categories is multiple, and each user category includes one or more users in the system; a weight determination module, configured to determine, for each user category, a screen viewing weight corresponding to the user category based on the user category and the screen viewing information of users in the system belonging to the user category; as well as The mode determination module is used to determine the display mode of the display device based on the numerical relationship between the screen viewing weights corresponding to each of the user categories, and the display modes include main screen exclusive mode, split screen negotiation mode and main and sub-screen mode.

Images