Information processing method and information processing system

Abstract

To provide a system which allows automatic generation / input of information context, interpretation possibility, and proper display design.SOLUTION: The present invention is directed to a method of generating and displaying context-based information. The method can include the steps of: automatically discriminating a person by a processor; discriminating a display device closet to the person by the processor; generating context information specific to the person by the processor; and displaying the context information on the display device browsed by the person.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure generally relates to information processing methods and information processing systems for generating and displaying context-based information.

Background Art

[0002] In industrial environments such as factory work sites, there are several displays for providing results indicating the state of the factory and periodic notifications. Responses to those periodic notifications can be important and, if unnoticed, can have catastrophic effects. The information requiring display has many conditions in a rapidly dynamic environment such as a factory work site. This information must have a context that is easy for employees to interpret and understand, be correctly displayed on the device, and have an instantaneous response mechanism that enables rapid notification.

[0003] In related art, methods for automatically positioning a display according to a viewer's location or gesture have been disclosed. An imaging device is used to find the user's location and change the physical specifications of the display via movement along the x-axis, y-axis, and z-axis to orient the display towards the user. The user can also assign specific gestures to set the display for a given specification. When multiple users are present, the imaging device can focus on the midpoint towards which the display should be angled.

[0004] In related art, methods for interacting with proximity-responsive displays have been disclosed. Using a proximity sensor, when a user interacts with any part of the display, a predetermined audiovisual or multimedia response is generated and provided.

[0005] In each of the related arts described above, there are limitations on the information to be displayed and the form in which such information is displayed. In addition, if there are differences in format between different displays, the format of the information must be pre-determined. In some cases, the only place where there is variation is the physical orientation of the display. There may be many different displays in a factory / facility. For example, overhead TV screens, laptop screens, small monitor displays, programmable logic controller (PLC) screens, and the like. How the information should be displayed must be pre-determined before it can be displayed at a designated location.

[0006] In addition, the related arts provide minimal customization tools and automation. The related arts do not consider the relationship between individual displays and multiple displays. When an individual / person moves around and continuously changes locations, the display on which the information is presented should also be dynamically changed to enable the individual's access to the information so that the response time can be maintained. In addition, the related arts provide minimal customization tools and automation in the generation of information and displays.

[0007] With the development of computer vision and radio frequency identification (RFID) technologies, it has become possible to identify / locate receiving employees and quickly notify such employees of information. However, the various displays in a factory / facility have different ways of displaying information that may include text, images, graphics, videos, etc. In addition, the various displays may have different sizes and different orientations. SUMMARY OF THE INVENTION PROBLEMS TO BE SOLVED BY THE INVENTION

[0008] Therefore, a system capable of automatically generating / inputting information context, interpretability, and appropriate display design is needed. MEANS FOR SOLVING THE PROBLEMS

[0009] This method includes automatically identifying a person by a processor, identifying a display device closest to the person by the processor, generating context information specific to the person by the processor, and displaying the context information on the display device browsed by the person. Automatically identifying a person is triggered by the detection of an event, and the person is identified as the person handling the event. may include.

Brief Description of the Drawings

[0013] [Figure 1] FIG. 100 is a diagram showing an exemplary system 100 for generating and displaying context-based information according to an exemplary embodiment. [Figure 2] FIG. 200 is an exemplary diagram for performing event detection and response generation on an event detection module 102 according to an exemplary embodiment. [Figure 3] FIG. 300 is a diagram showing an exemplary interface of an event response database 206 according to an exemplary embodiment. [Figure 4] FIG. 400 is a diagram showing an exemplary configuration of a person identification module 104 according to an exemplary embodiment. [Figure 5] FIG. 500 is a diagram showing an exemplary interface of a summarization technique database 402 according to an exemplary embodiment. [Figure 6] FIG. 600 is a diagram showing an exemplary interface of a display technique database 404 according to an exemplary embodiment. [Figure 7] FIG. 700 is a diagram showing an exemplary display technique template 700 according to an exemplary embodiment. [Figure 8] FIG. 800 is a diagram showing an exemplary display technique template 800 according to an exemplary embodiment. [Figure 9A] FIG. 900 is a diagram showing an exemplary method for performing employee identification and display identification using a person location determination module 106 and a display decision module 108 according to an exemplary embodiment. [Figure 9B]FIG. showing an exemplary method for performing employee identification and display identification using a person location determination module 106 and a display determination module 108, according to an exemplary embodiment. [Figure 9C] FIG. showing an exemplary method for performing employee identification and display identification using a person location determination module 106 and a display determination module 108, according to an exemplary embodiment. [Figure 9D] FIG. showing an exemplary method for performing employee identification and display identification using a person location determination module 106 and a display determination module 108, according to an exemplary embodiment. [Figure 10] FIG. showing an exemplary interface display 1000 of an employee route database 910, according to an exemplary embodiment. [Figure 11] FIG. showing an exemplary interface display 1100 of a display location database 912, according to an exemplary embodiment. [Figure 12] FIG. showing an exemplary scenario 1200 using the method shown in FIG. 9A, according to an exemplary embodiment. [Figure 13] FIG. showing an exemplary scenario 1300, according to an exemplary embodiment. [Figure 14] FIG. showing an exemplary scenario 1400, according to an exemplary embodiment. [Figure 15] FIG. showing an exemplary scenario 1500, according to an exemplary embodiment. [Figure 16] FIG. showing an exemplary computing environment having an exemplary computing device suitable for use in some exemplary embodiments. DETAILED DESCRIPTION OF THE INVENTION

[0014] Below, a general architecture for implementing various features of the present disclosure will be described with reference to the drawings. The drawings and the associated description are provided to illustrate exemplary embodiments of the present disclosure and are not intended to limit the scope of the present disclosure. Throughout the drawings, reference numerals are reused again to indicate the correspondence between the referenced elements.

[0015] The following detailed description provides details of the figures and exemplary embodiments of the present application. Reference numerals and descriptions of overlapping elements between the figures are omitted for clarity. The terms used throughout the description are provided as examples and are not intended to be limiting. For example, the use of the term "automated" may include fully automated or semi-automated implementations, including user or administrator control over specific aspects of the implementation, depending on the desired implementation by those skilled in the art practicing the implementation of the present application. The selection can be performed by the user via a user interface or other input means, or can be implemented via a desired algorithm. Exemplary embodiments as described herein are available either alone or in combination, and the functions of those exemplary embodiments can be implemented via any means according to the desired embodiment.

Example

[0016] A common problem in a factory or work environment is response time. In a work environment where employees are constantly on the move, it is impossible to provide information to employees by means other than verbally and update it quickly. If an employee has a display asset but is not paying attention to it or is not nearby, a significant amount of time can elapse between when an update is sent to the asset and when the update is viewed.

[0017] The exemplary embodiments described herein relate to a method of notification display that displays notifications / information for a specified individual or employee on a nearby display. This helps reduce the time it takes for an employee to receive a notification and provides the appropriate context and interpretability of information to enable prompt execution of actions. The exemplary embodiments described herein can minimize the amount of time between the occurrence of an event and the response to that event. For a particular event, a predetermined automatic response can be written to handle such an event. In the case of confidential information, appropriate privacy methods for employee permissions may be written. In the case of a response based on real-time information, sufficient contextualization of the information can be added in a legible and interpretable format.

[0018] The exemplary embodiments described herein can receive, summarize, and divide a large stream of information dynamically across multiple displays according to the context and content of the information and the events that have occurred. The exemplary embodiments described herein relate to a multifaceted system that learns as more events occur. For example, as more events occur, options for scribing those events and their associated protocols are stored and learned within the system. This reduces the amount of human intervention required and the speed at which events are responded to. The exemplary embodiments also enhance the interpretability and accessibility of information by dynamically updating the display with information formatted in a customizable manner.

[0019] In a manufacturing work site, operational events continuously occur and need to be detected, displayed / notified so that appropriate personnel can take actions to address the event. Such events can include the occurrence of defects in the parts being manufactured, machine downtime, mechanical defects in the machines, shortages of labor or raw materials, and the like.

[0020] Figure 1 shows an exemplary system 100 for generating and displaying context-based information according to an exemplary embodiment. System 100 may include components such as, but not limited to, an event detection module 102, a person identification module 104, a person location determination module 106, and a display decision module 108. The event detection module 102 helps to determine when an unexpected event has occurred and sends a signal notifying that the event has occurred to the person identification module 104.

[0021] Next, the person identification module 104 is triggered to process the event and identifies the individuals to be notified of the event. The person identification module 104 takes into account the permissions of those individuals and the permission to receive notifications, as well as techniques for appropriately shortening information for the information recipients. After the individual has been appropriately identified for the notification, the location of that individual needs to be determined in real time, which is performed by the person location determination module 106. The person location determination module 106 is connected in real time to the display decision module 108, and the display decision module 108 identifies the display device closest to the location of that individual.

[0022] Figure 2 shows an exemplary diagram 200 for performing event detection and response generation on the event detection module 102 according to an exemplary embodiment. As shown in Figure 2, after an event 202 occurs and is detected, the event 202 is analyzed by the event detection module 102 to determine a predetermined automatic response 204 for the event 202. An event response database 206 is used in determining the predetermined automatic response 204. The event response database 206 includes a collection of identified events and related automatic responses (actions / protocols). If the detected event 202 corresponds to an identified event included in the event response database 206 and there is a corresponding automatic response, the automatic response is used as the predetermined automatic response 204 for handling the event 202.

[0023] If the detected event 202 does not correspond to an event included in the event response database 206, the event scribe module 208 can be used to add the event 202 and the corresponding automatic response to the event response database 206. Similarly, if the detected event 202 corresponds to an identified event included in the event response database 206 that does not have a corresponding automatic response, the event scribe module 208 can be utilized to add the event 202 and the corresponding automatic response to the event response database 206.

[0024] Figure 3 shows an exemplary interface 300 of an event response database 206 according to an exemplary embodiment. As shown in Figure 3, the interface 300 can display information such as, but not limited to, event code 302, event name 304, result code 306, result name 308, and employee usage permission 310. Two event entries are shown in Figure 3. The first event has an event code of "246", and the second event has an event code of "312". The event code 302 is an event identifier associated with the event, and the event name 304 provides a name and additional information associated with the identified event. For example, in the case of the event code "246", the associated event name indicates that the belt conveyor is stopped and is associated with Machine A.

[0025] Result code 306 is the action identifier of a predetermined action / protocol associated with an event. For example, the result code "1A" is the action identifier of a predetermined action associated with an event having the event code "246". The result name 308 is the action information associated with the identified result code. The employee usage permission 310 provides information regarding the usage permission required to access the details / information. If no predetermined action / protocol can be found for an event, the user has the option to create an action for that event. As shown in FIG. 3, if no predetermined action / protocol can be found for an event, the new event addition button 312 can be selected. When the new event addition button 312 is clicked, the user has the option to select the action to be performed and set the corresponding employee usage permission level.

[0026] FIG. 4 shows an exemplary configuration of the stakeholder identification module 104 according to an exemplary embodiment. In order for information to be properly displayed, display adaptation and employee permissions must be taken into account when generating such information. The stakeholder identification module 104 may include components such as, but not limited to, a summary technique database 402, a display technique database 404, an employee permission calculation unit 406, etc., which provide and utilize various techniques when determining the information to be displayed.

[0027] The participant identification module 104 analyzes information related to an event (event 202) to determine summarization techniques to apply to the information. The summarization technique database 402 stores summarization techniques to be applied to received event information. The event 202 may include event information in at least one of two forms: visual information / aid and text information. The visual information / aid may include, but is not limited to, information such as graphs, tables, charts, diagrams, etc. If visual information / aid is present, a determination is made as to whether it is feasible to display the information in its entirety. If full display of the visual information / aid is not feasible, a summarization technique is retrieved from the summarization technique database 402 to convert / summarize the visual information / aid into a readable format (e.g., scrubbing, etc.). If text information is present, a summarization technique is retrieved to paraphrase the text into a format customized for the device to which the information is to be sent.

[0028] Various types of display devices may exist on a factory floor, each with its own specifications. One of the most important specifications used in generating information displays is display size. A display device with a larger display area can display more information compared to a display device with a smaller display area. While different displays may utilize the same paraphrase / summarization technique in the summarization technique database 402, the visual display in which the information is displayed may differ between the different displays. The display technique database 404 analyzes information associated with the event 202 to determine the display technique to be utilized for the information. Various formatting techniques are included in the display technique database 404 and are associated with the different summarization techniques found in the summarization technique database 402. The visual and textual information of the event 202 serves as input to the display technique database 404 in identifying or generating a display technique.

[0029] The employee privilege calculation unit 406 performs the calculation of employee privileges through the received employee information (e.g., rank, job authority, work rate, etc.). In some exemplary embodiments, the employee privilege calculation unit 406 further classifies employees into various categories based on the calculated privileges (e.g., administrator / manager, director, etc.).

[0030] FIG. 5 shows an exemplary interface 500 of the summary technique database 402 according to an exemplary embodiment. As shown in FIG. 5, the interface 500 can display information such as, but not limited to, a result code 502, a result name 504, an employee usage permission 506, a summary code 508, and a summary name 510. The result code 502, the result name 504, and the employee usage permission 506 correspond to the result code 306, the result name 308, and the employee usage permission 310 in FIG. 3. The column of the summary code 508 corresponds to identifiers of various summary techniques. The summary name 510 indicates a predetermined default summary technique associated with the summary code 508. As shown in FIG. 5, when the predetermined / default summary technique cannot be found, the new technique addition button 512 can be selected. When the new technique addition button 512 is clicked, the user has an option to select a summary technique to be applied and stored as a new default. In some exemplary embodiments, the user can create a new summary technique by selecting the type of information to be displayed and how to display such information on the interface 500.

[0031] FIG. 6 shows an exemplary interface 600 of a display technique database 404 according to an exemplary embodiment. As shown in FIG. 6, the interface 600 can display information such as, but not limited to, display code 602, display template 604, employee license 606, summary code 608, and summary name 610. The employee license 606, summary code 608, and summary name 610 correspond to the employee license 506, summary code 508, and summary name 510 in FIG. 5. The display code 602 corresponds to identifiers of various display devices. For example, 4A may represent a personal monitor display, and 4B may represent a tablet. The display template 604 shows the display template used for each combination of summary techniques and employee licenses. As shown in FIG. 6, if a predetermined / default display technique is not found, the new technique addition button 612 may be selected. When the new technique addition button 612 is clicked, the user has the option to select a display technique to be applied and stored as the new default. In some exemplary embodiments, the user can create a new summary technique by selecting the type of information to be displayed and how to display such information on the interface 600.

[0032] FIG. 7 shows an exemplary display technique template 700 according to an exemplary embodiment. The display technique template 700 corresponds to "Template 1" shown in FIG. 6 and is applied to a personal display device such as a computer monitor. The notification displayed from the event is represented by the notification display 702, while the remaining part of the screen, i.e., the display area 704, displays information related to the work or actions of employees related to the factory work site / facility. The report button 706 is provided as part of the notification display 702 for the employee / notification recipient to select when the processing of the event was successful.

[0033] The graphical display of information becomes possible if the size of the display device is given. For example, the graphic display of the efficiency of Machine A is shown in the notification display 702 of FIG. 7. Referring back to FIG. 6, the employee usage permission 606 indicates that the employee's permission for this information is "none specified", which means that there is no need to hide the confidential information, and the information of the event (e.g., the event name 304) can be displayed on the notification.

[0034] FIG. 8 shows an exemplary display technique template 800 according to an exemplary embodiment. The display technique template 800 corresponds to "Template 2" shown in FIG. 6 and is applied to a mobile display device such as a tablet. The notification displayed from the event is represented by the notification display 802, while the remaining part of the screen, i.e., the display area 804, displays information related to the work or actions of the employees related to the factory work site / facility. The report button 806 is provided as part of the notification display 802 for the employee / notification recipient to select when the processing of that event was successful.

[0035] The information display is limited when the size of the display area is given, which may involve reduction in the display of text information and / or graphical information. Referring back to FIG. 6, the employee usage permission 606 indicates that the employee's permission for this information is "admin", which means that it is necessary to hide the confidential information, and the information of the event (e.g., the event name 304) is not shown on the notification display 802. The employee using the tablet can notify the administrator, and the administrator can access this information in an external source to handle the event.

[0036] Figures 9A - 9D illustrate an exemplary method for performing employee identification and display identification using the person location determination module 106 and the display determination module 108 according to an exemplary embodiment. Figure 9A shows a first method of performing person detection using human recognition 902 and finding the nearest display device of the detected person using object recognition 904. The person location determination module 106 performs person location / sensing using a computer vision algorithm for performing human recognition 902. In some exemplary embodiments, human recognition 902 is performed using a face recognition algorithm. In some exemplary embodiments, a privacy-preserving human detection algorithm may be used instead of a face recognition algorithm to protect the privacy of employees. Next, the display decision module 108 uses object recognition 904 to find / identify the display device closest to the person.

[0037] Figure 12 illustrates an exemplary scenario 1200 using the method shown in Figure 9A according to an exemplary embodiment. Several machines such as machines 1202, 1204, and 1206 are operating indoors in a factory, and several employees (e.g., employees 1208 and 1210) are monitoring and maintaining those machines. Assuming that machine 1206 has failed and a warning notification has been sent to the central display 1216 for employees 1208 and 1210 to consider and address, employees 1208 and 1210 can view the machine diagnosis and related notifications on display devices 1212 and 1214. If the warning notification is not considered within a predetermined time and not dismissed (e.g., by checking a completion button displayed on the central display 1216), human recognition 902 is performed using the sensing device 1218 to identify employees (e.g., employee 1208) currently indoors in the factory. Next, object recognition 904 is performed using the sensing device 1218 to identify the display device closest to employee 1208, in this case, display device 1212. Then, a summarized notification is issued to display device 1212 for employee 1208 to consider.

[0038] Figure 9B shows a second method of identifying the location of a person of interest using badge detection 906. The person of interest location determination module 106 utilizes a radio frequency identification (RFID) locator to identify or detect the location of a person of interest within the work site. The RFID locator performs badge detection 906 on the person of interest RFID to identify the location of the nearest person of interest. In some exemplary embodiments, the RFID is tagged to various display devices (e.g., using an RFID tag or token, etc.), and tag detection 908 is performed by the display determination module 108 to identify the location of the display device closest to the identified person of interest.

[0039] Figure 9C shows a third method of using a path algorithm to identify the location of a person of interest / employee. The path algorithm utilizes an employee path database 910 to identify the location of a person of interest / employee. The employee path database 910 may include information regarding the primary, secondary, and tertiary work locations of an employee and their activities on any given day. In some exemplary embodiments, when used in conjunction with a display location database 912, a summarized notification may be issued and displayed on all three display devices associated with the primary, secondary, and tertiary work locations of the identified employee. The display location database 912 may include information identifying display devices and their associated locations. For example, the location of the nearest display device may be identified by comparing the distances of several display devices to the primary work location of the person of interest / employee. The employee path database 910 and the display location database 912 are described in more detail below.

[0040] Figure 9D shows a fourth method that utilizes both badge detection 906 and a routing algorithm. The interested party location determination module 106 utilizes a radio frequency identification (RFID) locator to identify / detect the location of interested parties within the vicinity of an event. When used in conjunction with the display location database 912, a summarized notification can be issued and displayed on a display device located at the primary worksite. In some exemplary embodiments, the RFID locator is used to determine the presence of interested parties at the scene.

[0041] Figure 10 shows an exemplary interface display 1000 of an employee routing database 910 according to an exemplary embodiment. As shown in Figure 10, the interface display 1000 can display information such as, but not limited to, employee ID 1002, primary location 1004, secondary location 1006, tertiary location 1008, and active status 1010. The employee ID 1002 includes a unique identification number representing various employees / interested parties. The primary location 1004 corresponds to the primary worksite associated with the employee / interested party. The secondary location 1006 corresponds to the secondary worksite associated with the employee / interested party. The tertiary location 1008 corresponds to the tertiary worksite associated with the employee / interested party. The active status 1010 corresponds to the work status of the employee / interested party on any given day and can include status determination (e.g., true, false, etc.) and work configuration (e.g., on-site, remote, hybrid, etc.). A new employee route can also be generated by selecting the new route addition button 1012.

[0042] Figure 11 shows an exemplary interface display 1100 of a display location database 912 according to an exemplary embodiment. As shown in Figure 11, the interface display 1100 can display information such as, but not limited to, asset ID 1102 and asset location 1104. The asset ID 1102 includes a unique identification number representing various display devices / assets. The asset location 1104 corresponds to the location of the asset. A new asset can also be generated by selecting the new asset addition button 1106.

[0043] FIG. 13 shows an exemplary scenario 1300 according to an exemplary embodiment. Some machines, such as machines 1302, 1304, and 1306, are operating within a factory floor, and several employees (e.g., employees 1308 and 1310) are monitoring and maintaining those machines. Assume that machine 1306 has failed and a warning notification has been sent to a central display 1316 for employees 1308 and 1310 to consider and address. Employees 1308 and 1310 can view machine diagnostics and related notifications on display devices 1312 and 1314. If the warning notification is not considered and dismissed (e.g., by checking a completion button displayed on central display 1316) within a predetermined time, badge detection 906 is performed through an antenna 1318 to search for nearby RFID badges (e.g., badges 1320 and 1322). Badge 1320 is associated with employee 1308, and badge 1322 is associated with employee 1310. When an employee, such as employee 1308, is determined to be nearby, an employee route database 910 is referenced to identify the primary work location of employee 1308. Then, a display location database 912 is utilized to identify the display device closest to the primary work location of employee 1308, such as display device 1312. Then, a summarized notification is issued to display device 1312 for employee 1308 to consider.

[0044] Figure 14 shows an exemplary scenario 1400 according to an exemplary embodiment. Several machines, such as machines 1402, 1404, and 1406, are operating within the factory floor, and several employees (e.g., employees 1408 and 1410) are monitoring and maintaining those machines. Employees 1408 and 1410 can view machine diagnostics and related notifications on display devices 1412 and 1414. Assume that machine 1406 has failed and a warning notification has been sent to the central display 1416 for employees 1408 and 1410 to consider and address. If the warning notification is not considered within a predetermined time and is not dismissed (e.g., by checking a completion button displayed on the central display 1416), the employee route database 910 is referenced / viewed to identify the most active employee closest to machine 1406, such as employee 1410. Next, the display location database 912 is utilized to identify the display device closest to machine 1406, such as display device 1414. Then, a summarized notification is issued to display device 1414 for employee 1410 to consider. If the summarized notification is not dismissed or considered within a predetermined time, employee identification is re-executed using the employee route database 910 to find another active employee.

[0045] In some exemplary embodiments, if both employees 1408 and 1410 are located by the employee route database 910 and determined to be available, the summarized notification is sent to some or all of the display devices associated with the employees' work locations.

[0046] FIG. 15 shows an exemplary scenario 1500 according to an exemplary embodiment. Some machines, such as machines 1502, 1504, and 1506, are operating within the factory floor, and several employees (e.g., employees 1508 and 1510) are monitoring and maintaining those machines. Employees 1508 and 1510 can view machine diagnostics and related notifications on display devices 1512 and 1514. Assume that machine 1506 has failed and a warning notification has been sent to the central display 1516 for employees 1508 and 1510 to consider and address. If the warning notification is not considered within a predetermined time and not dismissed (e.g., by checking a completion button displayed on the central display 1516), badge detection 906 and tag detection 908 are performed through antenna 1518 to search for nearby RFID badges (e.g., badges 1520 and 1522) and RFID tags (e.g., tags 1524 and 1526). Badge 1520 is associated with employee 1508, and badge 1522 is associated with employee 1510. Tag 1524 is associated with display device 1512, and tag 1526 is associated with display device 1514. When it is determined that an employee, such as employee 1508, is nearby, antenna 1518 searches for a device tag, such as tag 1524, near employee 1508. Then, a summarized notification is issued to display device 1512 for employee 1508 to consider. In some exemplary embodiments, the central display 1516 may be associated with tag 1528 and may be used for tag detection 908 for central display selection.

[0047] The above exemplary embodiments can have various benefits and advantages. For example, it enables a user to add authority and priority elements to a notification while maintaining the severity and urgency of the notification. Additionally, an infrastructure is provided that follows a predetermined protocol appropriate in all aspects of contextualization, summarization, and interpretability.

[0048] FIG. 16 illustrates an exemplary computing environment having an exemplary computing device suitable for use in some exemplary embodiments. The computing device 1605 in the computing environment 1600 can include one or more processing units, cores, or processors 1610, memory 1615 (e.g., RAM, ROM, and / or the like), internal storage 1620 (e.g., magnetic, optical, solid state storage, and / or organic), and / or an I / O interface 1625, any of which can be coupled on a communication mechanism or bus 1630 for communicating information, or can be incorporated into the computing device 1605. The I / O interface 1625 is further configured to receive images from a camera or provide images to a projector or display, depending on the desired implementation.

[0049] Computing device 1605 may be communicatively coupled to an input / user interface 1635 and an output device / interface 1640. One or both of the input / user interface 1635 and the output device / interface 1640 may be a wired or wireless interface and may be removable. The input / user interface 1635 may include any physical or virtual device, component, sensor, or interface (e.g., buttons, touch screen interface, keyboard, pointing / cursor control, microphone, camera, Braille, motion sensor, accelerometer, optical reader, and / or the like) that can be used to provide input. The output device / interface 1640 may include a display, television, monitor, printer, speaker, Braille, or the like. In some exemplary embodiments, the input / user interface 1635 and the output device / interface 1640 may be incorporated with or physically coupled to the computing device 1605. In other exemplary embodiments, other computing devices may function as or provide the functions of the input / user interface 1635 and the output device / interface 1640 for the computing device 1605.

[0050] Examples of computing device 1605 can include, but are not limited to, highly mobile devices (such as smartphones, devices mounted on vehicles and other machines, devices held by a person or animal, and the like), mobile devices (such as tablets, notebooks, laptops, personal computers, portable televisions, radios, and the like), and devices not designed for mobility (such as desktop computers, other computers, information kiosks, televisions with one or more processors incorporated therein and / or televisions with one or more processors coupled thereto, radios, and the like).

[0051] Computing device 1605 can be communicatively coupled to external storage 1645 and network 1650 (e.g., via I / O interface 1625) for communication with any number of network-connected components, devices, and systems, including one or more computing devices of the same or different configurations. Computing device 1605 or any other connected computing device can function as a server, client, synserver, general-purpose machine, dedicated machine, or otherwise, provide its services, or be referred to by those names.

[0052] I / O interface 1625 can include, but is not limited to, wired and / or wireless interfaces that use any communication or I / O protocol or convention (e.g., Ethernet®, 802.11x, Universal System Bus, WiMax®, modem, cellular network protocol, and the like) for information communication to and / or from at least all connected components, devices, and networks in computing environment 1600. Network 1650 can be any network or combination of networks (such as the Internet, local area network, wide area network, telephone network, cellular network, satellite network, and the like).

[0053] Computing device 1605 can use and / or communicate using a computer-usable medium or computer-readable medium that includes a transient medium and a non-transient medium. Transient media includes transmission media (such as metal cables, optical fibers), signals, carrier waves, and the like. Non-transient media includes magnetic media (such as disks and tapes), optical media (such as CD-ROMs, digital video disks, Blu-ray (registered trademark) disks), solid state media (such as RAM, ROM, flash memory, solid state storage), and other non-volatile storage or memory.

[0054] Computing device 1605 can be used to implement techniques, methods, applications, processes, or computer-executable instructions in some exemplary computing environments. Computer-executable instructions can be retrieved from a transient medium, stored in a non-transient medium, and retrieved therefrom. The executable instructions can be derived from one or more of any programming language, scripting language, and machine language (such as C, C++, C#, Java (registered trademark), Visual Basic, Python (registered trademark), Perl, JavaScript (registered trademark), etc.).

[0055] Processor 1610 can run under any operating system (OS) (not shown) in a native or virtual environment. One or more applications can be deployed that include a logic unit 1660, an application programming interface (API) unit 1665, an input unit 1670, an output unit 1675, and an inter-unit communication mechanism 1695 for inter-unit communication, communication with the OS, and communication with other applications (not shown). The units and elements described above can be different in design, function, configuration, or implementation manner and are not limited to the above description. Processor 1610 can be in the form of a hardware processor such as a central processing unit (CPU), or can be a combination of a hardware unit and a software unit.

[0056] In some exemplary embodiments, when information or execution instructions are received by API unit 1665, they can be communicated to one or more other units (e.g., logic unit 1660, input unit 1670, output unit 1675). In some examples, logic unit 1660 can control the information flow between units and can be configured to direct the services provided by API unit 1665, input unit 1670, and output unit 1675 in some of the exemplary embodiments described above. For example, one or more processes or execution flows can be controlled by logic unit 1660 alone or in conjunction with API unit 1665. Input unit 1670 may be configured to obtain inputs for the calculations described in the exemplary embodiments, and output unit 1675 may be configured to provide outputs based on the calculations described in the exemplary embodiments.

[0057] As shown in FIGS. 4 and 9A - 9D, the processor 1610 can be configured to automatically identify a person. The processor 1610 can also be configured to identify the display device closest to the person, as shown in FIGS. 4 and 9A - 9D. The processor 1610 can also be configured to generate context information specific to the person, as shown in FIGS. 4 and 9A - 9D. The processor 1610 can also be configured to display the context information on the display device browsed by the person, as shown in FIGS. 4 and 9A - 9D.

[0058] As shown in FIGS. 2 and 3, when an event is detected, the processor 1610 can be configured to analyze the event to detect the existence of a predetermined event response for the event. As shown in FIGS. 2 and 3, when a predetermined event response is detected, the processor 1610 can be further configured to notify the closest person having permission to handle the event and provide a solution to the action to the closest person who can handle the event, and the person is identified as the closest person.

[0059] The processor 1610 can also be configured to create a new event response for handling the event. The new event response includes event information, an action to be executed, and permission information. The action includes notifying the closest person having permission to handle the event to handle the event. The permission information is the required permission level of the closest person, as shown in FIGS. 2 and 3. The processor 1610 can also be further configured to notify the closest person having permission to handle the event and provide a solution to the action to the closest person who can handle the event, as shown in FIGS. 2 and 3. The processor 1610 can also be configured to retrieve the primary location of the person associated with the assigned activity of the person from the route database, as shown in FIGS. 9A - 9D.

[0060] Some portions of the detailed description are presented in terms of algorithms and symbolic representations of operations within a computer. These algorithmic descriptions and symbolic representations are the means used by those skilled in the data processing arts to convey the substance of their innovations to others skilled in the art. An algorithm is a series of defined steps leading to a desired end state or result. In exemplary implementations, the performed steps require physical manipulations of tangible quantities to achieve a tangible result.

[0061] Unless otherwise specified, and as will be apparent from the description, throughout this specification, descriptions utilizing words such as "processing," "calculating," "computing," "determining," "displaying," or the like, are understood to include the actions and processes of a computer system or other information processing device that manipulates and converts data represented as physical (electronic) quantities in the registers and memory of the computer system into other data similarly represented as physical quantities in the memory or registers of the computer system or other information storage, transmission, or display devices.

[0062] Exemplary embodiments may further relate to apparatus for performing the operations herein. This apparatus may be specially constructed for the desired purposes, or may include one or more general-purpose computers selectively activated or reconfigured by one or more computer programs. Such computer programs may be stored on a computer-readable medium, such as a computer-readable storage medium or a computer-readable signal medium. Computer-readable storage media may include tangible media, such as, but not limited to, optical disks, magnetic disks, read-only memory, random-access memory, solid-state devices and drives, or any other type of tangible or non-transitory medium suitable for storing electronic information. Computer-readable signal media may include media such as carrier waves. The algorithms and displays presented herein are not inherently related to any particular computer or other apparatus. A computer program may include a pure software implementation containing instructions for performing the operations of a desired embodiment.

[0063] Various general-purpose systems may be used with the programs and modules according to the examples herein, or it may eventually be convenient to construct specialized apparatus to perform the desired method steps. Additionally, the example embodiments are not described with reference to any particular programming language. It will be understood that a variety of programming languages may be used to implement the teachings of the example embodiments as described herein. Instructions of the programming language may be executed by one or more processing devices, such as, for example, a central processing unit (CPU), a processor, or a controller.

[0064] As is known in the art, the operations described above may be performed by hardware, software, or some combination of software and hardware. Various aspects of the exemplary embodiments may be implemented using circuits and logic devices (hardware), while other aspects may be implemented using instructions stored on a machine-readable medium (software) that, when executed by a processor, cause the processor to perform methods that implement the present application. Furthermore, some exemplary embodiments of the present application may be implemented solely in hardware, while other exemplary embodiments may be implemented solely in software. Furthermore, the various functions described may be performed in a single unit or may be distributed across multiple components in any number of ways. When implemented by software, the methods may be executed by a processor, such as a general-purpose computer, based on instructions stored on a computer-readable medium. If desired, the instructions may be stored on the medium in compressed and / or encrypted format.

[0065] Moreover, other implementations of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the teachings herein. Various aspects and / or components of the described exemplary embodiments may be used alone or in any combination. It is intended that the specification and exemplary embodiments be considered as examples only, with the true scope and spirit of the present application being indicated by the following claims. [Explanation of symbols]

[0066] 102 Event Detection Module 104 Participant Identification Module 106 Related Person Location Determination Module 108 Display Decision Module 204 Predefined Auto-Response 206 Event Response Database 208 Event Scribe Module 402 Summarization Technique Database 404 Display Technique Database 406 Employee Permission Calculation Department 910 Employee Route Database 912 Display Location Database 1635 Input / User Interface 1640 Output Device / Interface 1645 External Storage 1650 Network 1605 Computing Device 1625 I / O Interface 1620 Internal Storage 1615 Memory 1610 Processor 1660 Logic Unit 1665 API Unit 1670 Input Unit 1675 Output Unit

Claims

1. Automatically identifying a person by a processor, identifying, by the processor, the display device closest to the person, generating, by the processor, context information specific to the person, and displaying the context information on the display device viewed by the person, including, automatically identifying the person is triggered by the detection of an event, the person is identified as the person handling the event, An information processing method characterized by the above.

2. The information processing method according to claim 1, when the event is detected, analyzing, by the processor, the event to detect the existence of a predetermined event response to the event, when the predetermined event response is detected, notifying, by the processor, the closest person having permission to handle the event and providing a solution to the action to the closest person handling the event, the person being identified as the closest person, An information processing method characterized by the above.

3. The information processing method according to claim 2, when the predetermined event response is not detected, creating a new event response for handling the event, the new event response including event information, an action to be performed, and permission information, the action being to notify the closest person having permission to handle the event, and the permission information being the required permission level of the closest person, further including notifying, by the processor, the closest person having permission to handle the event and providing the solution to the action to the closest person for handling the event, An information processing method characterized by the above.

4. Automatically identifying a person by a processor, identifying, by the processor, the display device closest to the person, generating, by the processor, context information specific to the person, and displaying the context information on the display device viewed by the person, including, automatically identifying the person includes identifying an employee having the authority to handle an event, the person being identified as the employee, generating the context information specific to the person is, Calculating at least one of visual aids or text associated with the event; Retrieving the employee authority associated with the person; Applying a summarization technique among a plurality of summarization techniques to at least one of the visual aid or the text to generate the context information based on the employee authority; Determining a display technique among a plurality of display techniques for displaying the context information based on the display type of the display device, including: The plurality of display techniques includes a graphical display of information based on a display size and information display control based on the display size. An information processing method characterized by the above.

5. By a processor, automatically identifying a person; By the processor, identifying the display device closest to the person, generating context information specific to the person by the processor, and displaying the context information on the display device viewed by the person, including: Automatically identifying the person includes the processor performing human recognition for detecting the person among a plurality of persons using a computer vision algorithm. Identifying the display device closest to the person includes the processor performing object recognition to identify the display device from a plurality of display devices, and the display device is closest to the person compared to the plurality of display devices. Performing the human recognition is triggered by the occurrence of an event, and the person has permission to use for handling the event. An information processing method characterized by the above.

6. By a processor, automatically identifying a person; By the processor, identifying the display device closest to the person, generating context information specific to the person by the processor, and displaying the context information on the display device viewed by the person, including: Automatically identifying the person includes the processor performing RFID detection on RFID tags held by the plurality of persons to identify the person from among the plurality of persons. An information processing method characterized by the above.

7. The information processing method according to claim 6, Identifying the display device closest to the person includes the processor performing at least one of object recognition or RFID detection to identify the display device from a plurality of display devices, where the display device is closest to the person compared to the plurality of display devices. An information processing method characterized by the above.

8. By a processor, automatically identifying a person, The processor identifying the display device closest to the person, the processor generating context information specific to the person, and displaying the context information on the display device viewed by the person. The processor retrieving the primary location of the person associated with the assigned activity of the person from a route database. The display device is the display device closest in distance to the primary location. An information processing method characterized by the above.

9. The information processing method according to claim 8, Automatically identifying the person includes the processor performing RFID detection on a radio frequency identification (RFID) tag carried by the person to identify the person's presence on-site. An information processing method characterized by the above.

10. Including a plurality of display devices, And a processor, The processor is configured to Automatically identify a person, Identify the display device closest to the person among the plurality of display devices, Generate context information specific to the person, Display the context information on the display device viewed by the person, And is configured to perform the above, The processor automatically identifying the person is triggered by the detection of an event, The person is identified as the person handling the event. An information processing system characterized by the above.

11. The information processing system according to claim 10, The processor is configured to When the event is detected, analyze the event to detect the presence of a predetermined event response to the event. When the predetermined event response is detected, notify the nearest person having permission to handle the event and provide an action solution to the nearest person who is to handle the event, and is further configured to do so, and the person is identified as the nearest person, An information processing system characterized by the above.

12. The information processing system according to claim 11, wherein when the processor does not detect the predetermined event response, create a new event response for handling the event, the new event response including event information, an action to be performed, and permission information, the action being to notify the nearest person having permission to handle the event, and the permission information being the required permission level of the nearest person, notify the nearest person having permission to handle the event and provide the action solution to the nearest person for handling the event, and is further configured to do so, An information processing system characterized by the above.

13. A plurality of display devices and including a processor, the processor is configured to automatically identify a person, identify the display device closest to the person among the plurality of display devices, generate context information specific to the person, display the context information on the display device viewed by the person, and is configured to perform the above, the processor is configured to automatically identify the person by identifying an employee having the authority to handle the event, and the person is identified as the employee, the processor is configured to receive at least one of a visual aid or text associated with the event, calculate the employee authority associated with the person, apply, to the at least one of the visual aid or the text, a summarization technique among a plurality of summarization techniques based on the employee authority to generate the context information, and determine a display technique among a plurality of display techniques for displaying the context information based on the display type of the display device, so as to generate the context information specific to the person. The plurality of display techniques includes graphical display of information based on the display size and information display control based on the display size. An information processing system characterized by the above.

14. A plurality of display devices, including a processor, wherein the processor automatically identifies a person, identifies the display device among the plurality of display devices that is closest to the person, generates context information specific to the person, and displays the context information on the display device viewed by the person, and is configured to perform the above, wherein the processor is configured to automatically identify the person by performing human recognition for detecting the person among a plurality of persons using a computer vision algorithm, wherein the processor is configured to identify the display device close to the person by performing object recognition to identify the display device from among the plurality of display devices, wherein the execution of the human recognition is triggered by the occurrence of an event, and the person has a permission to use for handling the event. An information processing system characterized by the above.

15. A plurality of display devices, including a processor, wherein the processor automatically identifies a person, identifies the display device among the plurality of display devices that is closest to the person, generates context information specific to the person, and displays the context information on the display device viewed by the person, and is configured to perform the above, wherein the processor is configured to automatically identify the person by performing RFID detection on RFID tags held by the plurality of persons to identify the person from among the plurality of persons. An information processing system characterized by the above.

16. The information processing system according to claim 15, wherein the processor is configured to identify the display device close to the person by performing at least one of object recognition or RFID detection to identify the display device from among the plurality of display devices. An information processing system characterized by the above.

17. A plurality of display devices, including a processor, wherein the processor automatically identifies a person, Identifying the display device among the plurality of display devices that is closest to the person; Generating context information specific to the person; Displaying the context information on the display device viewed by the person; is configured to perform; the processor is further configured to retrieve from the route database the primary location of the person associated with the assigned activity of the person; the display device is the display device closest in distance to the primary location; An information processing system characterized by the above.

18. The information processing system according to claim 17, the processor is configured to automatically identify the person by performing RFID detection on a radio frequency identification (RFID) tag held by the person to identify the person's on-site presence; An information processing system characterized by the above.

Images