Business management system, business management method and business management procedure

Abstract

In a business management system (1) according to an exemplary embodiment of the present invention, a user PC (10) determines whether the position of the user's iris detected by analyzing an image is within a corresponding screen area, and when the position of the user's iris is within the corresponding screen area, calculates the viewpoint coordinates on the display screen, and uses the coordinate information of the application screen displayed on the display screen and the viewpoint coordinates to identify the application that provides the application screen viewed by the user. Then, a management server (20) determines whether the identified application is a predetermined application used in the business, and calculates the usage time of the application determined as the predetermined application.

Description

Technical Field

[0001] The present invention relates to a business management system, a business management method and a business management program, and more specifically, to a business management system, a business management method and a business management program for obtaining the actual business status of staff using an application (hereinafter referred to as "application"). Background Art

[0002] Conventionally, various techniques have been proposed to monitor the work status of a worker performing teleworking. For example, a remote work status monitoring system disclosed in Patent Document 1 is intended to monitor the work status of a worker based on the operating status of the worker's personal computer (PC).

[0003] Reference List

[0004] Patent Literature

[0005] Patent Document 1: Japanese Unexamined Patent Application Publication No. 2000-48078 Summary of the invention

[0006] Technical issues

[0007] However, because the remote work status monitoring system disclosed in Patent Document 1 only monitors the operating status of non-work processes such as games or screen savers as the operating status of the PC, it is difficult to obtain the usage time of applications used by staff in their business. Therefore, there is a problem that it is difficult to obtain the actual business status of the staff in detail.

[0008] In view of the above problems, an object of the present invention is to provide a business management system, a business management method and a business management program capable of obtaining the actual business status of staff using an application.

[0009] Solution to the problem

[0010] A service management system according to an exemplary embodiment of the present invention includes:

[0011] an analysis unit, analyzing the image and detecting the user's iris;

[0012] a position determination unit that, when the user's iris is detected, determines whether the position of the user's iris in the image is within a corresponding screen area corresponding to a display screen displaying the application screen;

[0013] a viewpoint coordinate calculation unit, which calculates the viewpoint coordinates of the user's viewpoint represented on the display screen based on the position of the user's iris when the position of the user's iris is within the corresponding screen area;

[0014] an application identifying unit that identifies an application that provides an application screen viewed by a user, using coordinate information of an application screen displayed on a display screen and viewpoint coordinates;

[0015] an application determination unit that determines whether the identified application is a predetermined application used in the business; and

[0016] The time calculation unit calculates the usage time of the application determined as the predetermined application when the identified application is determined as the predetermined application.

[0017] Beneficial effects of the present invention

[0018] According to the present invention, a business management system, a business management method and a business management program capable of acquiring the actual business status of a worker using an application can be provided. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 is a schematic diagram illustrating an exemplary embodiment of a business management system according to an exemplary embodiment of the present invention.

[0020] Figure 2 is a block diagram showing a detailed configuration of a user PC according to an exemplary embodiment of the present invention.

[0021] Figure 3 is a block diagram showing a detailed configuration of a management server according to an exemplary embodiment of the present invention.

[0022] Figure 4 is a block diagram illustrating main components of a user PC and a management server according to an exemplary embodiment of the present invention.

[0023] Figure 5 is a diagram showing an example of a data storage table.

[0024] Figure 6 is a flowchart illustrating an example of a process performed by a user PC according to an exemplary embodiment of the present invention.

[0025] Figure 7 is a flowchart illustrating an example of a process performed by a management server according to an exemplary embodiment of the present invention.

[0026] Figure 8 is a flowchart illustrating an example of a process performed by a management server according to an exemplary embodiment of the present invention.

[0027] Fig. 9 : is a diagram showing an example of adding an added target time to a scheduled time.

[0028] Fig.10 is a diagram showing an example of an image.

[0029] Fig.11 This is a diagram for explaining the method of calculating viewpoint coordinates.

[0030] Fig.12 is a diagram showing an example of an image generated by a management server according to an exemplary embodiment of the present invention. DETAILED DESCRIPTION

[0031] Hereinafter, exemplary embodiments of the present invention will be described with reference to the accompanying drawings. Figure 1 1 is a schematic diagram showing an exemplary embodiment of a business management system 1 according to the present invention. The business management system 1 includes a user PC 10, a management server 20, a manager PC 30, a user PC 50, and an imaging device 60.

[0032] The user PC 10, the management server 20 and the manager PC 30 may be installed at a workplace of a managed worker, for example, in a company, etc. The user PC 10, the management server 20 and the manager PC 30 may communicate data with each other via an internal network 40 such as a local area network (LAN).

[0033] The user PC 10 is an information processing device that implements a remote desktop function that can be remotely operated. And the managed staff can use the application or data of the user PC 10 using the user PC 50. Figure 2 The details of the functions of the user PC 10 are described.

[0034] The management server 20 is an information processing device that uses information provided by the user PC 10 to calculate the usage time of each application, non-business working time, and the time when the staff member to be managed leaves his / her seat. Figure 3 Functional details of the management server 20 are described.

[0035] The manager PC 30 is an information processing device used by the manager of the managed staff. The manager PC 30 requests an image indicating the usage time of each application, non-business working time, and the time when the managed staff leaves his / her seat from the management server 20, and then displays the image obtained from the management server 20 on the display device of the manager PC 30.

[0036] The user PC 50 and the imaging device 60 are installed in the work space (such as home) of the managed staff. The user PC 50 has a remote desktop function that can remotely operate the user PC 10. The user PC 50 can access the user PC 10 in the company through a virtual private network (VPN) 70 to use the application and data of the user PC 10.

[0037] The imaging device 60 is communicatively connected to the user PC 50. The imaging device 60 is installed at a position where the face of the user of the user PC 50 (particularly the eyes of the user) can be imaged. The imaging device 60 performs imaging processing at predetermined time intervals. The predetermined time interval may generally be the time (200 milliseconds, etc.) for a person to gaze at one place when reading a sentence. When the imaging device 60 performs imaging processing to generate an image, it sends the image to the user PC 50. It should be noted that an imaging device integrated with the user PC 50 may be used instead of the imaging device 60.

[0038] The user PC 50 sends the image provided by the imaging device 60, the coordinate information of the screen provided by the application used by the user as the managed staff (hereinafter referred to as the "application screen"), and the information indicating the position of the application screen in the front-to-back direction to the user PC 10 in the company through the VPN 70 and the company's internal network 40. The coordinate information of the application screen includes information indicating the coordinates of the application screen displayed on the display device of the user PC 50, identification information of the application providing the application screen, and date and time information when the application screen is displayed. The information indicating the position of the application screen in the front-to-back direction includes information indicating the position of the application screen displayed in a virtually overlapping manner in the front-to-back direction, identification information of the application providing the application screen, and date and time information when the application screen is displayed. The user PC 50 can send this information to the user PC 10 at the above-mentioned predetermined time intervals.

[0039] Figure 2 1 is a block diagram showing a detailed configuration of a user PC 10 according to an exemplary embodiment of the present invention. The user PC 10 includes a computing device 100, a communication interface (I / F) 110, and a storage device 120. The computing device 100 is a computing device such as a central processing unit (CPU) or a microprocessing unit (MPU). The computing device 100 executes a business management program according to an exemplary embodiment of the present invention, thereby executing a business management method according to an exemplary embodiment of the present invention. The program executed by the computing device 100 includes a monitoring unit 101, an analyzing unit 102, a position calculating unit 103, a position determining unit 104, a viewpoint coordinate calculating unit 105, an application (AP) identifying unit 106, a database (DB) processing unit 107, and an information providing unit 108. These program modules can be implemented as functions of a unified communication (UC) application.

[0040] The monitoring unit 101 is a program module that determines whether an image, coordinate information of an application screen, and information indicating the position of the application screen in the front-rear direction are received from the user PC 50. Upon receiving these information, the monitoring unit 101 stores the information in the storage device 120.

[0041] The analysis unit 102 is a program module that analyzes an image stored in the storage device 120 to detect the user's iris. The analysis unit 102 acquires an image from the storage device 120 to determine whether the user's iris is included in the image.

[0042] The position calculation unit 103 is a program module that calculates the position of the user's iris in the image. Fig.10 As shown, the position calculation unit 103 can calculate the center position C of the user's iris, that is, the center position of the pupil.

[0043] The position determination unit 104 is a program module that determines whether the center position C of the user's iris exists in an area corresponding to the display screen of the display device of the user PC 50 (hereinafter referred to as "corresponding screen area"). Fig.10 As shown, the upper left end Ptl, lower left end Pbl, upper right end Ptr and lower right end Pbr of the corresponding screen area correspond to the upper right end, lower right end, upper left end and lower left end of the display screen of the display device of the user PC 50, respectively.

[0044] The upper left end Ptl of the corresponding screen area is equivalent to the center position C of the iris when the user is looking at the upper right end of the display screen of the display device of the user PC 50. The lower left end Pbl of the corresponding screen area is equivalent to the center position C of the iris when the user is looking at the lower right end of the display screen. The upper right end Ptr of the corresponding screen area is equivalent to the center position C of the iris when the user is looking at the upper left end of the display screen. The lower right end Pbr of the corresponding screen area is equivalent to the center position C of the iris when the user is looking at the lower left end of the display screen. Each of the ends Ptl, Pbl, Ptr, and Pbr of the corresponding screen area can be determined by lighting up each end of the display screen of the display device of the user PC 50 individually and using each image when the user is looking at each end of the display screen.

[0045] The viewpoint coordinate calculation unit 105 is a program module that calculates the viewpoint coordinates of the user's viewpoint on the display screen of the display device indicating the user PC 50 based on the center position C of the user's iris in the corresponding screen area. Fig.11 As shown in FIG. 1 , when the lower left end of the display screen of the display device of the user PC 50 is set as the origin, the viewpoint coordinate calculation unit 105 calculates the distances in the X and Y directions from the lower right end Pbr of the corresponding screen area corresponding to the origin to the center position C. For example, when the lengths in the X and Y directions of the corresponding screen area are 1, respectively, Fig.11The distances of the center position C in the X and Y directions are 0.7 and 0.5 respectively. When the resolution of the display screen of the display device of the user PC 50 is 1920×1080, the user's viewpoint coordinates are (X, Y)=(1344(=1920×0.7), 540(=1080×0.5)).

[0046] The AP identification unit 106 is a program module that uses the coordinate information of the application screen displayed on the display screen of the user PC 50 and the user's viewpoint coordinates to identify the application that provides the application screen viewed by the user. The AP identification unit 106 acquires the coordinate information of the application screen from the storage device 120 to determine whether the user's viewpoint coordinates are included in the area defined by the coordinate information, that is, whether they are included in the application screen. When the user's viewpoint coordinates are included in the application screen, the AP identification unit 106 identifies the application that provides the application screen.

[0047] When the application screens are displayed in a virtually overlapping manner, the AP identification unit 106 acquires information indicating the position of the application screen in the front-to-back direction in addition to acquiring the coordinate information of the application screen from the storage device 120. When the viewpoint coordinates of the user are included in the area where the application screens are displayed in a virtually overlapping manner, the AP identification unit 106 can identify the application providing the frontmost application screen based on the information indicating the position of the application screen in the front-to-back direction.

[0048] The DB processing unit 107 is a program module that registers information in a data storage table generated in the storage device 120 in response to a request from another program module. Figure 5 As shown, in the data storage table, date and time information indicating the generation date and time of the image, the determination result about the iris and viewpoint of the user, the viewpoint coordinates, and the identification information of the application are registered.

[0049] The determination results about the user's iris and viewpoint include a determination result that the user's iris center position C is within the corresponding screen area, a determination result that the user's iris center position C is outside the corresponding screen area, and a determination result that the user's iris is not detected. The determination result that the user's iris center position C is within the corresponding screen area means that the user is viewing the display screen of the display device of the user PC 50. The determination result that the user's iris center position C is outside the corresponding screen area means that the user is viewing an area other than the display screen of the display device of the user PC 50. The identification information of the application is the identification information of the application that provides the application screen browsed by the user.

[0050] When the center position C of the user's iris is within the corresponding screen area, the determination result indicating this, the viewpoint coordinates, and the identification information of the application are registered in association with the date and time information. When the center position C of the user's iris is outside the corresponding screen area, the determination result indicating this is registered in association with the date and time information. When the user's iris is not detected, the determination result indicating this is registered in association with the date and time information.

[0051] The information providing unit 108 is a program module that provides the information recorded in the data storage table to the management server 20. The information providing unit 108 can provide the information recorded in the data storage table to the management server 20 at any time, for example, when the user service ends.

[0052] The communication I / F 110 is a device that transmits and receives various data between the user PC 10 and the user PC 50 or the management server 20 through the in-house network 40 and the VPN 70. The storage device 120 is a storage device that stores various types of information such as a program according to an exemplary embodiment of the present invention, an image provided by the user PC 50, coordinate information of an application screen, information indicating the position of the application screen in the front-rear direction, and a data recording table.

[0053] Figure 3 2 is a block diagram showing a detailed configuration of the management server 20 according to an exemplary embodiment of the present invention. The management server 20 includes a computing device 200, a communication interface (I / F) 210, and a storage device 220.

[0054] The computing device 200 is a computing device such as a CPU or an MPU. The computing device 200 executes the program according to the exemplary embodiment of the present invention, thereby executing the method according to the exemplary embodiment of the present invention. The program executed by the computing device 200 includes a monitoring unit 201, an application (AP) determination unit 202, a browsing determination unit 203, a time calculation unit 204, and a display image generation unit 205.

[0055] The monitoring unit 201 is a program module that determines whether information transmitted by the user PC 10 has been received. When the monitoring unit 201 receives information from the user PC 10, that is, information recorded in the data storage table of the user PC 10, the monitoring unit 201 registers the information in the data recording table of the storage device 220.

[0056] The AP determination unit 202 is a program module that determines whether the application whose identification information is registered in the data record table of the storage device 220 is a predetermined application used for business by the user of the user PC 50. The predetermined application may be predetermined by a person who manages the business of the user, etc. The AP determination unit 202 determines whether the identification information of the application registered in the data record table of the storage device 220 matches the identification information of the predetermined application, thereby being able to determine whether the application whose identification information is registered in the data record table is the predetermined application.

[0057] The browsing determination unit 203 is a program module that determines whether the user of the user PC 50 has viewed the application screen in a specific time period in the past based on the date and time of image generation. The specific time period in the past may be, for example, a time period of 10 seconds back from the time indicated by the date and time information as the date and time of image generation. The browsing determination unit 203 determines whether the identification information of the application is associated with the date and time information equivalent to the specific time period in the past by referring to the data record table of the storage device 220, thereby being able to determine whether the user of the user PC 50 has viewed the application screen in the specific time period.

[0058] The time calculation unit 204 is a program module that calculates the application usage time, the non-business work time, and the time during which the user is away from the seat of the user PC 50. The time calculation unit 204 adds a predetermined time (e.g., 200 milliseconds) based on the execution cycle time of the imaging process of the imaging device 60, thereby being able to calculate the application usage time, the non-business work time, and the time during which the user is away from the seat.

[0059] The display image generation unit 205 is a program module that generates an image that displays at least one of the usage time of each application determined as a predetermined application, the usage rate of each application per unit time (e.g., working time per day, etc.), the non-business working time, and the time during which the user leaves the seat. The usage rate of the application can be calculated based on the usage time of the application. The display image generation unit 205 generates an image in response to a request from the manager PC 30 to provide the image to the manager PC 30. Fig.12 The image shown is displayed on the display device of the manager PC 30 . Fig.12 The graph shown shows the usage time for each application, non-business work time, and time spent away from your desk.

[0060] Communication I / F 210 is a device that transmits and receives various data between management server 20 and user PC 10 or manager PC 30 through in-house network 40. Storage device 220 is a storage device that stores various types of information such as programs and data record tables according to an exemplary embodiment of the present invention.

[0061] Figure 4 1 is a block diagram showing main components included in the user PC 10 and the management server 20 according to an exemplary embodiment of the present invention. The user PC 10 includes an analyzing unit 102, a position determining unit 104, a viewpoint coordinate calculating unit 105, and an AP identifying unit 106. The management server 20 includes an AP determining unit 202, a browsing determining unit 203, and a time calculating unit 204.

[0062] Figure 6 1 is a flowchart showing an example of a process performed by the user PC 10 according to an exemplary embodiment of the present invention. The user PC 10 performs a Figure 6 In step S101, the analysis unit 102 of the user PC 10 acquires the image provided by the user PC 50 from the storage device 120 to analyze the image. In step S102, the analysis unit 102 determines whether the user's iris is detected. When the user's iris is not detected (No), in step S103, the analysis unit 102 registers the determination result indicating that the iris is not detected in the data record table using the DB processing unit 107, and Figure 6 The processing is finished.

[0063] On the other hand, when the user's iris is detected (Yes), the process branches to step S104. In step S104, the position calculation unit 103 calculates the center position C of the user's iris in the image. In step S105, the position determination unit 104 determines whether the center position C of the iris is within the corresponding screen area. When the center position C of the iris is outside the corresponding screen area (No), in step S106, the position determination unit 104 registers the determination result that the center position C of the iris is outside the corresponding screen area in the data record table using the DB processing unit 107, and Figure 6 The processing is finished.

[0064] On the other hand, when the center position C of the iris is within the corresponding screen area (Yes), in step S107, the viewpoint coordinate calculation unit 105 calculates the viewpoint coordinates of the user on the display screen of the display device of the user PC 50 based on the center position C of the user's iris in the corresponding screen area. In step S108, the AP identification unit 106 acquires the coordinate information of the application screen displayed on the display device of the user PC 50 and the information indicating the position of the application screen in the front-to-back direction associated with the image acquired in step S101 from the storage device 120. The AP identification unit 106 can identify the coordinate information of the application screen associated with the image and the information indicating the position of the application screen in the front-to-back direction based on the generation date and time of the image and the date and time when the application screen is displayed.

[0065] In step S109, the AP identification unit 106 identifies the application that provides the application screen viewed by the user based on the user's viewpoint coordinates, the coordinate information of the application screen, and the information indicating the position of the application screen in the front-back direction. In step S110, the AP identification unit 106 registers the determination result that the iris center position C is within the corresponding screen area and the identification information of the application viewed by the user in the data record table using the DB processing unit 107, and Figure 6 The processing is finished.

[0066] Figure 7 2 is a flowchart showing an example of a process performed by the management server 20 according to an exemplary embodiment of the present invention. In step S201, the AP determination unit 202 selects recorded data associated with a time from the recorded data stored in the storage device 220. In step S202, the AP determination unit 202 branches the process based on the determination result of the selected recorded data. More specifically, when the determination result indicates that the center position C of the user's iris is within the corresponding screen area, the process branches to step S203. When the determination result indicates that the center position C of the user's iris is outside the corresponding screen area, the process branches to step S207. When the determination result indicates that the user's iris is not detected, the process branches to step S209.

[0067] In step S203, the AP determination unit 202 determines whether the application indicated by the AP identification information of the selected recorded data is a scheduled application. When the application indicated by the AP identification information is a scheduled application (Yes), in step S204, the time calculation unit 204 adds the scheduled time to the usage time of the application. On the other hand, when the application indicated by the AP identification information is not a scheduled application (No), in step S205, the time calculation unit 204 adds the scheduled time to the non-business working time.

[0068] In step S206, the AP determination unit 202 determines whether there is any recorded data that has not been selected. When there is any recorded data that has not been selected (Yes), the process returns to step S201, and the above-mentioned process is performed on the recorded data associated with the next time. On the other hand, when there is no recorded data that has not been selected (No), Figure 7 The processing is finished.

[0069] When the determination result in step S202 indicates that the center position C of the user's iris is outside the corresponding screen area, the process of step S207 is performed. In step S207, the browsing determination unit 203 refers to the data record table of the storage device 220 to determine whether the identification information of the application is associated with the date and time information indicating the date and time equivalent to the specific time period in the past. The specific time period in the past is a time period based on the date and time indicated by the date and time information of the recorded data selected in step S201. When the identification information of the application is associated with at least one of the date and time information of the specific time period (yes), the process branches to step S203.

[0070] In this case, the AP determination unit 202 determines whether the application is a predetermined application. When the application is a predetermined application, the time calculation unit 204 adds the predetermined time to the usage time of the application. More specifically, the time calculation unit 204 adds the time period during which the center position C of the user's iris is outside the corresponding screen area to the usage time of the application determined as the predetermined application.

[0071] On the other hand, when the identification information of the application is not associated with any of the date and time information of the specific time period (No), the process branches to step S208. In step S208, the time calculation unit 204 adds the scheduled time to the non-business working time, and the process proceeds to step S206.

[0072] When the determination result indicates that the user's iris is not detected in step S202, the process of step S209 is performed. In step S209, similar to step S207, the browsing determination unit 203 refers to the data record table of the storage device 220 to determine whether the identification information of the application is associated with the date and time information indicating the date and time equivalent to the specific time period in the past. When the identification information of the application is associated with at least one of the date and time information of the specific time period (yes), the process branches to step S203.

[0073] In this case, the AP determination unit 202 determines whether the application is a predetermined application. When the application is a predetermined application, the time calculation unit 204 adds the predetermined time to the usage time of the application. More specifically, the time calculation unit 204 adds the period during which the user's iris is not detected to the usage time of the application determined as the predetermined application.

[0074] On the other hand, when the identification information of the application is not associated with any of the date and time information of the specific time period (No), the process branches to step S210. In step S210, the time calculation unit 204 adds the predetermined time to the time during the absence from the seat, and the process proceeds to step S206.

[0075] In the above-described exemplary embodiment, the analysis unit 102 of the user PC 10 analyzes the image generated by the imaging device 60 to determine whether the user's iris is detected. When the user's iris is detected, the position determination unit 104 determines whether the position of the user's iris in the image is within the corresponding screen area to register the determination result in the data record table. When the position of the user's iris is within the corresponding screen area, the viewpoint coordinate calculation unit 105 calculates the viewpoint coordinates based on the iris position within the corresponding screen area to register the viewpoint coordinates in the data record table. Next, the AP identification unit 106 uses the coordinate information of the application screen displayed on the display screen and the viewpoint coordinates to identify the application that provides the application screen viewed by the user to register the identification information of the application in the data record table. Then, the information providing unit 108 sends the information registered in the data record table to the management server 20.

[0076] When the management server 20 receives the information from the user PC 10, the AP determination unit 202 determines whether the application indicated by the identification information included in the information is a predetermined application. When it is determined that the application is a predetermined application, the time calculation unit 204 calculates the usage time of the application determined as the predetermined application. Thus, the usage time of the application used in the business is calculated, and the manager can obtain the actual business status of the staff member who uses the application used in the business.

[0077] In the above exemplary embodiment, when the user's iris is not detected in the image, the browsing determination unit 203 determines whether the user has viewed the screen of the application within a specific time period in the past based on the generation date and time of the image. When it is determined that the user has viewed the screen of the application within the specific time period in the past, the AP determination unit 202 determines whether the application is a predetermined application. When it is determined that the application is a predetermined application, the time calculation unit 204 adds the time period in which the user's iris is not detected to the usage time of the application.

[0078] As a result, even when the iris is not detected due to the user blinking during work, Fig. 9 As shown, the time period when the iris is not detected can also be added to the application usage time. Therefore, the user's application usage time can be accurately recorded, and the manager can accurately obtain the actual business status of the staff to be managed.

[0079] Furthermore, in the above exemplary embodiment, when the user's iris position is outside the corresponding screen area in the image, the browsing determination unit 203 determines whether the user has viewed the screen of the application within a specific time period in the past based on the generation date and time of the image. When it is determined that the user has viewed the screen of the application within the specific time period in the past, the AP determination unit 202 determines whether the application is a predetermined application. When it is determined that the application is a predetermined application, the time calculation unit 204 adds the time period during which the user's iris position is outside the corresponding screen area to the usage time of the application.

[0080] As a result, for example, even when the user's iris position is outside the corresponding screen area because the user is looking at the keyboard, mouse, materials, etc. at hand while using the application, the time period when the iris position is outside the corresponding screen area can be added to the application usage time. Therefore, the user's actual application usage time can be recorded, and the manager can accurately obtain the actual business status of the managed staff.

[0081] Furthermore, in the above exemplary embodiment, the display image generation unit 205 generates an image that displays at least one of the following for each application: the usage time of the application determined as the predetermined application; and the usage rate of the application per unit time based on the usage time of the application. As a result, the manager can easily obtain the actual business status of the managed staff.

[0082] In the above examples, the program can be stored and provided to the computer by using various types of non-transitory computer-readable media. Non-transitory computer-readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (e.g., floppy disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROMs, CD-Rs, CD-R / Ws, semiconductor memories (e.g., mask ROMs, programmable ROMs (PROMs), erasable PROMs (EPROMs), flash ROMs, RAMs). The program can also be provided to the computer via various types of temporary computer-readable media. Examples of temporary computer-readable media include electrical signals, optical signals, and electromagnetic waves. Temporary computer-readable media can provide the program to the computer via a wired communication path or a wireless communication path such as wires and optical fibers.

[0083] The present invention is not limited to the above-described exemplary embodiments, and may be appropriately modified without departing from the spirit of the present invention. For example, in another exemplary embodiment, instead of the user PC 10, a virtual PC such as a virtual personal computer (VPC) may be installed on an information processing device such as the management server 20. In this case, a single information processing device such as the management server 20 executes a program according to the exemplary embodiment of the present invention (including the above-described program modules included in the user PC 10) to perform a method according to the exemplary embodiment of the present invention. In the present exemplary embodiment, the user PC 50 sends an image, coordinate information of an application screen, and information indicating the position of the application screen in the front-to-back direction to the information processing device via the VPN 70 and the company's internal network 40. Then, a computing device included in the information processing device executes Figures 6 to 8 Processing shown.

[0084] In another exemplary embodiment, a facial authentication function for identifying the managed staff can be provided to the user PC 10. In this case, only when the user is identified as a genuine user, the date and time information of the image, the determination result, the viewpoint coordinates, and the identification information of the application as described above are registered in the data record table. As a result, deception can be prevented, and the manager can obtain the actual business status of the managed staff in detail.

[0085] In addition, in another exemplary embodiment, the management server 20 may be an external server installed at a place other than the workplace of the managed staff. In addition, the functions of the program modules included in the user PC 10 and the management server 20 may be implemented by circuits such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC).

[0086] This application is based upon and claims the benefit of priority from Japanese patent application No. 2019-234345, filed on December 25, 2019, the disclosure of which is incorporated herein in its entirety by reference.

[0087] Reference numerals list

[0088] 1 Business Management System

[0089] 10 User PC

[0090] 100 computing devices

[0091] 102 Analysis Unit

[0092] 104 Position determination unit

[0093] 105 Viewpoint coordinate calculation unit

[0094] 106 AP identification unit

[0095] 20 Management Server

[0096] 200 computing devices

[0097] 202 AP determination unit

[0098] 204 Time calculation unit

[0099] 203 Browse confirmed units

[0100] 205 Display image generation unit.

Claims

1. A business management system, comprising: An analysis component, configured to analyze the image to detect the user's iris; a position determination component, for determining, when the iris of the user is detected, whether the position of the iris of the user in the image is within a corresponding screen area corresponding to a display screen displaying an application screen; a viewpoint coordinate calculation unit, configured to calculate the viewpoint coordinates of the viewpoint of the user represented on the display screen based on the position of the iris of the user when the position of the iris of the user is within the corresponding screen area; an application identifying means for identifying an application providing an application screen viewed by the user using coordinate information of the application screen displayed on the display screen and the viewpoint coordinates; an application determination component, for determining whether the identified application is a predetermined application used in the business; a time calculation component, for calculating the usage time of the application determined as the predetermined application when the identified application is determined as the predetermined application; as well as A browsing determination component is used to determine whether the user has viewed the screen of the identified application within a specific time period in the past based on the date and time of generation of the image when the user's iris is not detected, wherein: When it is determined that the user has viewed the screen of the identified application within the past specific period of time, the application determination section determines whether the identified application is the predetermined application, and When it is determined that the identified application is the predetermined application, the time calculation section adds a time period during which the iris of the user is not detected to the usage time of the application determined to be the predetermined application.

2. The business management system according to claim 1, wherein: When the position of the user's iris is outside the corresponding screen area, the browsing determination unit determines whether the user has viewed the screen of the identified application within a specific time period in the past based on the generation date and time of the image, When it is determined that the user has viewed the screen of the identified application within the past specific period of time, the application determination section determines whether the identified application is the predetermined application, and When it is determined that the identified application is the predetermined application, the time calculation section adds a time period during which the position of the user's iris is outside the corresponding screen area to the usage time of the application determined as the predetermined application.

3. A business management system, comprising: An analysis component, configured to analyze the image to detect the user's iris; a position determination component, for determining, when the iris of the user is detected, whether the position of the iris of the user in the image is within a corresponding screen area corresponding to a display screen displaying an application screen; a viewpoint coordinate calculation unit, configured to calculate the viewpoint coordinates of the viewpoint of the user represented on the display screen based on the position of the iris of the user when the position of the iris of the user is within the corresponding screen area; an application identifying means for identifying an application providing an application screen viewed by the user using coordinate information of the application screen displayed on the display screen and the viewpoint coordinates; an application determination component, for determining whether the identified application is a predetermined application used in the business; a time calculation component, for calculating the usage time of the application determined as the predetermined application when the identified application is determined as the predetermined application; as well as A browsing determination component is used to determine whether the user has viewed the screen of the identified application within a specific time period in the past based on the generation date and time of the image when the position of the user's iris is outside the corresponding screen area, wherein: When it is determined that the user has viewed the screen of the identified application within the past specific period of time, the application determination section determines whether the identified application is the predetermined application, and When it is determined that the identified application is the predetermined application, the time calculation section adds a time period during which the position of the user's iris is outside the corresponding screen area to the usage time of the application determined as the predetermined application.

4. A business management method executed by a computer, comprising: Detecting the user's iris by analyzing the image; When the user's iris is detected, determining whether the position of the user's iris in the image is within a corresponding screen area corresponding to a display screen displaying an application screen; When the position of the user's iris is within the corresponding picture area, calculating viewpoint coordinates representing the user's viewpoint on the display picture based on the position of the user's iris; identifying an application providing the application screen viewed by the user using coordinate information of the application screen displayed on the display screen and the viewpoint coordinates; determining whether the identified application is an intended application for use in the business; When the identified application is determined to be the predetermined application, calculating the usage time of the application determined to be the predetermined application; When the iris of the user is not detected, determining whether the user has viewed a screen of the identified application within a specific time period in the past based on a generation date and time of the image; When it is determined that the user has viewed the screen of the identified application within the past specific time period, determining whether the identified application is the predetermined application; as well as When it is determined that the identified application is the predetermined application, a time period during which the iris of the user is not detected is added to the usage time of the application determined to be the predetermined application.

5. The service management method according to claim 4, further comprising: When the position of the user's iris is outside the corresponding screen area, determining whether the user has viewed the screen of the identified application within a specific time period in the past based on the generation date and time of the image; When it is determined that the user has viewed the screen of the identified application within the past specific time period, determining whether the identified application is the predetermined application; as well as When it is determined that the identified application is the predetermined application, a time period during which the position of the user's iris is outside the corresponding screen area is added to the usage time of the application determined as the predetermined application.

6. The service management method according to claim 4, further comprising: When the user's iris is detected, associating identification information of the identified application with date and time information of the image; when the user's iris is not detected, not associating the identification information of the identified application with the date and time information of the image; as well as It is determined whether the identification information of the identified application is associated with the date and time information of the image corresponding to the past specific time period, thereby determining whether the user viewed the screen of the identified application within the past specific time period.

7. The service management method according to claim 4, further comprising: generating an image, the image displaying at least one of the following for each application: usage time of the application determined as the predetermined application; and a usage rate of the application per unit time based on the usage time of the application.

8. A business management method executed by a computer, comprising: Detecting the user's iris by analyzing the image; When the user's iris is detected, determining whether the position of the user's iris in the image is within a corresponding screen area corresponding to a display screen displaying an application screen; When the position of the user's iris is within the corresponding picture area, calculating viewpoint coordinates representing the user's viewpoint on the display picture based on the position of the user's iris; identifying an application providing the application screen viewed by the user using coordinate information of the application screen displayed on the display screen and the viewpoint coordinates; determining whether the identified application is an intended application for use in the business; When the identified application is determined to be the predetermined application, calculating the usage time of the application determined to be the predetermined application; When the position of the user's iris is outside the corresponding screen area, determining whether the user has viewed the screen of the identified application within a specific time period in the past based on the generation date and time of the image; When it is determined that the user has viewed the screen of the identified application within the past specific time period, determining whether the identified application is the predetermined application; as well as When it is determined that the identified application is the predetermined application, a time period during which the position of the user's iris is outside the corresponding screen area is added to the usage time of the application determined as the predetermined application.

9. The service management method according to claim 8, further comprising: When the position of the user's iris is within the corresponding picture area, associating the identification information of the identified application with the date and time information of the image; When the position of the user's iris is outside the corresponding picture area, not associating the identification information of the identified application with the date and time information of the image; as well as It is determined whether the identification information of the identified application is associated with the date and time information of the image corresponding to the past specific time period, thereby determining whether the user viewed the screen of the identified application within the past specific time period. 10 . A computer-readable medium storing a service management program, wherein the service management program enables a computer to execute the service management method according to claim 4 .

Images