Information processing method and information processing system

Abstract

To provide a system which allows automatic generation / input of information context, interpretation possibility, and proper display design.SOLUTION: The present invention is directed to a method of generating and displaying context-based information. The method can include the steps of: automatically discriminating a person by a processor; discriminating a display device closet to the person by the processor; generating context information specific to the person by the processor; and displaying the context information on the display device browsed by the person.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] FIELD OF THE DISCLOSURE The present disclosure generally relates to information processing methods and systems for generating and displaying context-based information. [Background technology]

[0002] In an industrial environment, such as a factory floor, several displays exist to provide results and periodic notifications that indicate the status of the factory. Responses to those periodic notifications can be critical and can have catastrophic effects if not noticed. The information that requires display has many conditions in a rapidly dynamic environment, such as a factory floor. This information must be easy for employees to interpret, have enough context to be understandable, be displayed correctly on the device, and have an instant response mechanism to allow for rapid notification.

[0003] In the related art, a method is disclosed for automatic positioning of a display according to a viewer's location or gesture. An imaging device is utilized to find the user's location and modify the physical specifications of the display via movement along the x, y and z axes to orient the display towards the user. The user can also assign specific gestures to set the display to a given specification. When multiple users are present, the imaging device can converge on a midpoint to which the display should be angled.

[0004] In the related art, a method for interacting with a proximity responsive display is disclosed in which a proximity sensor is utilized to generate and provide a predetermined audiovisual or multimedia response when a user interacts with any portion of the display.

[0005] In each of the related art discussed above, there are limitations to the information that is displayed and the form in which such information is displayed. Additionally, if there are differences in format between different displays, the format of the information must be determined in advance. In some cases, the only place there is variation is the physical orientation of the display. A factory / facility may have many different displays. For example, overhead television screens, laptop screens, small monitor displays, programmable logic controller (PLC) screens, etc. How the information should be displayed must be determined in advance before it can be displayed in a specified location.

[0006] Additionally, the related art provides minimal customization tools and automation. The related art fails to consider the relationship between individual views and multiple views. As an individual / person moves around and continuously changes location, the view on which information is shown should also be dynamically changed to allow the individual access to the information so that response times are sustainable. Additionally, the related art provides minimal customization tools and automation in the generation of information and views.

[0007] With the development of computer vision and radio frequency identification (RFID) technology, it has become possible to identify / locate the recipient employee and quickly communicate information to that employee. However, various signs in a factory / facility have different methods for displaying information, which may include text, images, graphics, video, etc. Additionally, various signs may have different sizes and different orientations. Summary of the Invention [Problem to be solved by the invention]

[0008] Therefore, a system is needed that can automatically generate / input information context, interpretability, and appropriate display design. [Means for solving the problem]

[0009] Aspects of the present disclosure involve an innovative method for generating and displaying context-based information that may include automatically identifying, by a processor, a person, identifying, by a processor, a display device that is in closest proximity to the person, generating, by the processor, contextual information specific to the person, and displaying the contextual information on a display device viewed by the person.

[0010] Aspects of the present disclosure involve an innovative non-transitory computer-readable medium storing instructions for generating and displaying context-based information, which may include automatically identifying a person, identifying a display device closest to the person, generating contextual information specific to the person, and displaying the contextual information on a display device viewed by the person.

[0011] Aspects of the present disclosure involve an innovative server system for generating and displaying context-based information that may include automatically identifying, by a processor, a person, identifying, by a processor, a display device in closest proximity to the person, generating, by the processor, contextual information specific to the person, and displaying the contextual information on a display device viewed by the person.

[0012] Aspects of the present disclosure involve an innovative system for generating and displaying context-based information that may include means for automatically identifying a person, means for identifying a display device in closest proximity to the person, means for generating contextual information specific to the person, and means for displaying the contextual information on a display device viewed by the person. [Brief description of the drawings]

[0013] [Figure 1] FIG. 1 illustrates an example system 100 for generating and displaying context-based information, according to one example implementation. [Diagram 2]2 is an exemplary diagram 200 for performing event detection and response generation on an event detection module 102 according to an exemplary implementation. [Diagram 3] FIG. 3 illustrates an example interface 300 of the event response database 206 according to one example implementation. [Figure 4] FIG. 1 illustrates an exemplary configuration of a participant identification module 104, according to one exemplary implementation. [Diagram 5] FIG. 5 illustrates an example interface 500 of the summarization techniques database 402 according to one exemplary implementation. [Figure 6] FIG. 6 illustrates an example interface 600 of the display technique database 404 according to one exemplary implementation. [Figure 7] FIG. 7 illustrates an exemplary display technique template 700, according to an exemplary implementation. [Figure 8] FIG. 8 illustrates an exemplary display technique template 800, according to one exemplary implementation. [Figure 9A] FIG. 2 illustrates an example method for performing employee identification and display identification using a participant location determination module 106 and a display determination module 108 according to an example implementation. [Figure 9B] FIG. 2 illustrates an example method for performing employee identification and display identification using a participant location determination module 106 and a display determination module 108 according to an example implementation. [Figure 9C] FIG. 2 illustrates an example method for performing employee identification and display identification using a participant location determination module 106 and a display determination module 108 according to an example implementation. [Figure 9D] FIG. 2 illustrates an example method for performing employee identification and display identification using a participant location determination module 106 and a display determination module 108 according to an example implementation. [Figure 10] FIG. 10 illustrates an exemplary interface display 1000 of an employee route database 910 according to one exemplary implementation. [Figure 11] FIG. 11 illustrates an exemplary interface display 1100 of the display location database 912 according to one exemplary implementation. [Figure 12] FIG. 12 illustrates an example scenario 1200 using the method illustrated in FIG. 9A, according to one exemplary implementation. [Figure 13] FIG. 13 illustrates an exemplary scenario 1300, according to one exemplary implementation. [Figure 14] FIG. 14 illustrates an exemplary scenario 1400, according to one exemplary implementation. [Figure 15] FIG. 15 illustrates an exemplary scenario 1500, according to one exemplary implementation. [Figure 16] FIG. 1 illustrates an exemplary computing environment having an exemplary computing device suitable for use in some exemplary implementations. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] A generic architecture for implementing various features of the present disclosure is described below with reference to the drawings. The drawings and the associated description are provided to illustrate exemplary embodiments of the present disclosure and are not intended to limit the scope of the present disclosure. Throughout the drawings, reference numbers are also used again to indicate correspondence between referenced elements.

[0015] The following detailed description provides details of the figures and exemplary implementations of the present application. Reference numbers and descriptions of elements that overlap between figures are omitted for clarity. Terms used throughout the description are provided as examples and are not intended to be limiting. For example, the use of the term "automatic" may include fully automatic or semi-automatic implementations, including user or administrator control over particular aspects of the implementation, depending on the desired implementation of the person skilled in the art practicing the implementation of the present application. Selection may be performed by a user via a user interface or other input means, or may be performed via a desired algorithm. The exemplary implementations as described herein may be utilized either alone or in combination, and the functionality of the exemplary implementations may be implemented via any means according to the desired embodiment. EXAMPLES

[0016] A common problem within a factory or work environment is response time. In a work environment where employees are constantly on the move, it is not possible to provide employees with information and rapid updates by any means other than verbally. If an employee has an asset to display but is not paying attention to or near the asset, a significant amount of time can pass between when an update is sent to the asset and when the update is seen.

[0017] Exemplary embodiments described herein relate to a method of notification display that displays notifications / information to designated individuals or employees on a nearby display. This helps reduce the time it takes for employees to be notified and provides proper context and interpretability of the information to enable rapid action. Exemplary embodiments described herein can minimize the amount of time between the occurrence of an event and a response to that event. For certain events, predefined automated responses can be written to handle such events. In case of sensitive information, appropriate privacy methods for employee privileges may be written. In case of immediate information-based responses, sufficient contextualization of the information can be added in a readable and interpretable format.

[0018] The exemplary implementations described herein can dynamically receive, summarize, and routinely partition large streams of information across multiple displays depending on the context and content of the information and the events that have occurred. The exemplary implementations described herein relate to a multifaceted system that learns as more events occur. For example, as more events occur, options to scribe those events and their associated protocols are stored and learned within the system. This reduces the amount of human intervention required and the speed at which events are responded to. The exemplary implementations also increase the interpretability and accessibility of information by dynamically updating the displays with information formatted in a customizable manner.

[0019] In a manufacturing shop floor, operational events occur continuously and require that the events be detected and indicated / notified so that appropriate parties can take action to address the event. Such events may include the occurrence of defects in the parts being manufactured, machine downtime, mechanical defects in the machines, labor or raw material shortages, etc.

[0020] 1 illustrates an exemplary system 100 for generating and displaying context-based information, according to one exemplary implementation. System 100 may include components such as, but not limited to, an event detection module 102, a participant identification module 104, a participant location determination module 106, and a display decision module 108. Event detection module 102 helps determine when an unexpected event has occurred and sends a signal to participant identification module 104 notifying the event that has occurred.

[0021] The participant identification module 104 is then triggered to process the event and identify individuals who should be notified of the event. The participant identification module 104 takes into account the individual's authority and permission to be notified, as well as techniques to appropriately shorten the information for the information recipient. After an individual is properly identified for the notification, the individual's location needs to be determined in real-time, which is performed by the participant location determination module 106. The participant location determination module 106 is in real-time communication with the display determination module 108, which identifies the closest display device to the individual's location.

[0022] 2 illustrates an example diagram 200 for performing event detection and response generation on the event detection module 102, according to one example implementation. As shown in FIG. 2, after an event 202 occurs and is detected, the event 202 is analyzed by the event detection module 102 to determine a predefined automatic response 204 to the event 202. An event response database 206 is used in determining the predefined automatic response 204. The event response database 206 includes a collection of identified events and associated automatic responses (actions / protocols). If the detected event 202 corresponds to an identified event included in the event response database 206 and a corresponding automatic response exists, the automatic response is used as the predefined automatic response 204 to address the event 202.

[0023] If the detected event 202 does not correspond to an event included in the event response database 206, the event scribe module 208 may be used in adding the event 202 and the corresponding automated response to the event response database 206. Similarly, if the detected event 202 corresponds to an identified event included in the event response database 206 that does not have a corresponding automated response, the event scribe module 208 may be utilized in adding the event 202 and the corresponding automated response to the event response database 206.

[0024] 3 illustrates an example interface 300 of the event response database 206 according to one exemplary implementation. As shown in FIG. 3, the interface 300 can display information such as, but not limited to, an event code 302, an event name 304, a result code 306, a result name 308, and an employee authorization 310. Two event entries are shown in FIG. 3, a first event having an event code "246" and a second event having an event code "312." The event code 302 is an event identifier associated with the event, and the event name 304 provides a name and additional information associated with the identified event. For example, for the event code "246," the associated event name indicates that the conveyor belt is stopped and is associated with machine A.

[0025] Result code 306 is the action identifier of the predefined action / protocol associated with the event. For example, result code "1A" is the action identifier of the predefined action associated with the event having event code "246". Result name 308 is the action information associated with the identified result code. Employee clearance 310 provides information regarding the clearance required to access the details / information. If a predefined action / protocol is not found for an event, the user has the option to create an action for that event. As shown in FIG. 3, if a predefined action / protocol is not found for an event, an add new event button 312 can be selected. When clicking the add new event button 312, the user has the option to select the action to be performed and set the corresponding employee clearance level.

[0026] 4 illustrates an exemplary configuration of the participant identification module 104, according to one exemplary implementation. In order for information to be displayed appropriately, display adaptation and employee authority must be taken into consideration when generating such information. The participant identification module 104 provides and utilizes various techniques in determining the information to be displayed, and may include components such as, but not limited to, a summary technique database 402, a display technique database 404, and an employee authority calculator 406.

[0027] The participant identification module 104 analyzes information related to an event (event 202) to determine summarization techniques to be applied to the information. The summarization techniques database 402 stores the summarization techniques to be applied to the received event information. The event 202 may include event information in two forms: visual information / aid and / or text information. The visual information / aid may include information such as, but not limited to, graphs, tables, charts, diagrams, etc. If visual information / aid is present, a determination is made as to whether it is feasible to display the information in its entirety. If full display of the visual information / aid is not feasible, a summarization technique is retrieved from the summarization techniques database 402 to convert / summarize the visual information / aid into a readable form (e.g., scrubbing, etc.). If text information is present, a summarization technique is retrieved to paraphrase the text into a format customized for the device to which the information is to be sent.

[0028] Various types of display devices may exist on the factory floor, each with its own specifications. One of the most important specifications used in generating information displays is the display size. Display devices with larger display areas can display more information compared to display devices with smaller display areas. Although different displays may utilize the same paraphrase / summarization techniques of the summarization techniques database 402, the visual display in which the information is displayed may differ between the different displays. The display techniques database 404 analyzes information related to the event 202 to determine the display technique to be utilized for the information. Various formatting techniques are included in the display techniques database 404 and are associated with the different summarization techniques found in the summarization techniques database 402. The visual and textual information of the event 202 acts as input to the display techniques database 404 in identifying or generating a display technique.

[0029] The employee authority computation unit 406 performs an employee authority computation through the received employee information (e.g., rank, job authority, utilization rate, etc.) In some exemplary implementations, the employee authority computation unit 406 further classifies employees into various categories based on the computed authority (e.g., manager / owner, executive, etc.).

[0030] FIG. 5 illustrates an exemplary interface 500 of the summarization technique database 402, according to one exemplary implementation. As shown in FIG. 5, the interface 500 can display information such as, but not limited to, a result code 502, a result name 504, an employee authorization 506, a summary code 508, and a summary name 510. The result code 502, the result name 504, and the employee authorization 506 correspond to the result code 306, the result name 308, and the employee authorization 310 of FIG. 3. The summary code 508 column corresponds to identifiers of various summarization techniques. The summary name 510 indicates a predefined default summarization technique associated with the summarization code 508. As shown in FIG. 5, if a predefined / default summarization technique cannot be found, an add new technique button 512 can be selected. Clicking the add new technique button 512 allows the user to have the option to select a summarization technique to be applied and stored as a new default. In some exemplary implementations, the user can create a new summarization technique by selecting the type of information to display and how such information is to be displayed on the interface 500.

[0031] FIG. 6 illustrates an exemplary interface 600 of the display technique database 404 according to one exemplary implementation. As shown in FIG. 6, the interface 600 can display information such as, but not limited to, a display code 602, a display template 604, an employee use authorization 606, a summary code 608, and a summary name 610. The employee use authorization 606, the summary code 608, and the summary name 610 correspond to the employee use authorization 506, the summary code 508, and the summary name 510 of FIG. 5. The display code 602 corresponds to identifiers of various display devices. For example, 4A may represent a personal monitor display, and 4B may represent a tablet. The display template 604 indicates the display template to be used for each combination of summary technique and employee use authorization. As shown in FIG. 6, if a predefined / default display technique cannot be found, an add new technique button 612 may be selected. When clicking the add new technique button 612, the user has the option to select a display technique to be applied and stored as a new default. In some exemplary implementations, a user can create new summarization techniques by selecting the types of information to display and how such information is displayed on interface 600 .

[0032] 7 illustrates an exemplary display technique template 700 according to one exemplary implementation. Display technique template 700 corresponds to "Template 1" illustrated in FIG. 6 and is applied to a personal display device such as a computer monitor. The displayed notification from the event is represented by a notification display 702, while the remainder of the screen, i.e., display area 704, displays information related to the employee's work or actions related to the factory floor / facility. A report button 706 is provided as part of the notification display 702 for the employee / notification recipient to select when the event has been successfully handled.

[0033] Graphical display of information is possible given the size of the display device. For example, a graphical display of the efficiency of Machine A is shown in notification display 702 of Figure 7. Referring again to Figure 6, employee permissions 606 indicate that employee authorization for this information is "unspecified," meaning that confidential information does not need to be hidden, and event information (e.g., event name 304) may be displayed on the notification.

[0034] 8 illustrates an exemplary display technique template 800 according to one exemplary implementation. Display technique template 800 corresponds to "template 2" illustrated in FIG. 6 and is adapted for a mobile display device such as a tablet. The displayed notification from the event is represented by a notification display 802, while the remainder of the screen, i.e., display area 804, displays information related to the employee's work or actions associated with the factory floor / facility. A report button 806 is provided as part of the notification display 802 for the employee / notification recipient to select when the event has been successfully handled.

[0035] The information display is limited given the size of the display area, which may involve a reduction in the display of textual and / or graphical information. Referring again to Figure 6, employee permissions 606 indicate that the employee authority for this information is "Administrator," meaning that confidential information should be hidden, and no information about the event (e.g., event name 304) is shown on the notification display 802. The employee using the tablet can notify the administrator, who can then access this information in the external source to handle the event.

[0036] 9A-9D illustrate an exemplary method for performing employee identification and display identification using the participant location determination module 106 and the display determination module 108, according to one exemplary implementation. FIG. 9A illustrates a first method that utilizes human recognition 902 to perform participant detection and object recognition 904 to find the nearest display device of the detected participant. The participant location determination module 106 utilizes computer vision algorithms to perform the human recognition 902 to locate / detect the participant. In some exemplary implementations, the human recognition 902 is performed using a facial recognition algorithm. In some exemplary implementations, a privacy-preserving human detection algorithm may be used instead of a facial recognition algorithm to protect the privacy of the employee. The display determination module 108 then utilizes object recognition 904 to find / locate the nearest display device to the participant.

[0037] FIG. 12 illustrates an exemplary scenario 1200 using the method illustrated in FIG. 9A according to one exemplary implementation. Several machines, such as machines 1202, 1204, and 1206, are operating in a factory room, and several employees (e.g., employees 1208 and 1210) are monitoring and maintaining the machines. Assuming that machine 1206 is broken and a warning notification is sent to central display 1216 for employees 1208 and 1210 to review and act upon, employees 1208 and 1210 can view machine diagnostics and related notifications on display devices 1212 and 1214. If the warning notification is not reviewed and dismissed (e.g., by checking a done button displayed on central display 1216) within a predetermined time, human recognition 902 is performed using sensing device 1218 to identify an employee currently in the factory room, such as employee 1208. Object recognition 904 is then performed which uses sensing device 1218 to identify the display device closest to employee 1208, in this case display device 1212. A summarized notification is then published to display device 1212 for review by employee 1208.

[0038] 9B illustrates a second method of locating a participant using badge detection 906. The participant location determination module 106 utilizes a radio frequency identification (RFID) locator to locate or detect a participant within a work site. The RFID locator performs badge detection 906 on the participant RFID to locate the nearest participant. In some exemplary implementations, RFIDs are tagged (e.g., using RFID tags or tokens, etc.) to various display devices, and tag detection 908 is performed by the display determination module 108 to locate the nearest display device to the identified participant.

[0039] FIG. 9C illustrates a third method of utilizing a route algorithm to identify the location of a participant / employee. The route algorithm utilizes an employee route database 910 to identify the location of a participant / employee. The employee route database 910 may include information regarding an employee's primary, secondary, and tertiary work locations and the employee's activities on any given day. In some exemplary implementations, when used in conjunction with a display location database 912, a summarized notification may be issued and displayed on all three display devices associated with the identified employee's primary, secondary, and tertiary work locations. The display location database 912 may include information identifying the display devices and their associated locations. For example, by comparing the distance of several display devices to the participant / employee's primary work location, the location of the closest display device may be identified. The employee route database 910 and the display location database 912 are described in more detail below.

[0040] 9D illustrates a fourth method that utilizes both badge detection 906 and a routing algorithm. The participant location determination module 106 utilizes radio frequency identification (RFID) locators to locate / detect participants within the vicinity of the event. When used in conjunction with the display location database 912, summarized notifications can be issued and displayed on a display device located at the primary work location. In some exemplary implementations, RFID locators are used to determine that participants are present at the scene.

[0041] FIG. 10 illustrates an exemplary interface display 1000 of the employee route database 910 according to one exemplary implementation. As shown in FIG. 10, the interface display 1000 can display information such as, but not limited to, an employee ID 1002, a primary location 1004, a secondary location 1006, a tertiary location 1008, and an active status 1010. The employee ID 1002 includes unique identification numbers representing various employees / parties. The primary location 1004 corresponds to a primary work location with which the employee / parties are associated. The secondary location 1006 corresponds to a secondary work location with which the employee / parties are associated. The tertiary location 1008 corresponds to a tertiary work location with which the employee / parties are associated. The active status 1010 corresponds to the work status of the employee / parties on any given day and can include a status determination (e.g., true, false, etc.) and a work configuration (e.g., on-site, remote, hybrid, etc.). A new employee route can also be created by selecting an add new route button 1012.

[0042] 11 illustrates an example interface display 1100 of the display location database 912, according to one example implementation. As shown in FIG. 11, the interface display 1100 may display information such as, but not limited to, an asset ID 1102 and an asset location 1104. The asset ID 1102 includes a unique identification number that represents various display devices / assets. The asset location 1104 corresponds to the location of the asset. New assets may also be created by selecting an add new asset button 1106.

[0043] 13 illustrates an exemplary scenario 1300 according to one exemplary implementation. Several machines, such as machines 1302, 1304, and 1306, are operating in a factory room, and several employees (e.g., employees 1308 and 1310) are monitoring and maintaining the machines. Assuming that machine 1306 is broken and a warning notification is sent to central display 1316 for employees 1308 and 1310 to review and act upon, employees 1308 and 1310 can view machine diagnostics and related notifications on display devices 1312 and 1314. If the warning notification is not reviewed and dismissed (e.g., by checking a done button displayed on central display 1316) within a predetermined time, badge detection 906 is performed via antenna 1318 to search for nearby RFID badges (e.g., badges 1320 and 1322). Badge 1320 is associated with employee 1308, and badge 1322 is associated with employee 1310. Once an employee, e.g., employee 1308, is determined to be nearby, the employee route database 910 is consulted to identify a primary work location for the employee 1308. The display location database 912 is then utilized to identify a display device, e.g., display device 1312, that is closest to the primary work location for the employee 1308. A summarized notification is then published to the display device 1312 for review by the employee 1308.

[0044] 14 illustrates an exemplary scenario 1400 according to one exemplary implementation. Several machines, such as machines 1402, 1404, and 1406, are operating in a factory room, and several employees (e.g., employees 1408 and 1410) are monitoring and maintaining the machines. The employees 1408 and 1410 can view machine diagnostics and related notifications on display devices 1412 and 1414. Assume that the machine 1406 is broken and a warning notification is sent to the central display 1416 for the employees 1408 and 1410 to review and act upon. If the warning notification is not reviewed and dismissed (e.g., by checking a done button displayed on the central display 1416) within a predetermined time, the employee route database 910 is consulted / viewed to identify the active employee, such as employee 1410, that is closest to the machine 1406. The display location database 912 is then utilized to identify the display device, such as display device 1414, that is closest to the machine 1406. The summarized notification is then published to the display device 1414 for review by the employee 1410. If the summarized notification is not released or reviewed within a predetermined time, employee identification is re-performed using the employee route database 910 to find another active employee.

[0045] In some example implementations, if both employees 1408 and 1410 are located by the employee route database 910 and determined to be available, a summarized notification is sent to some or all display devices associated with the employee's work location.

[0046] 15 illustrates an exemplary scenario 1500 according to one exemplary implementation. Several machines, such as machines 1502, 1504, and 1506, are operating in a factory room, and several employees (e.g., employees 1508 and 1510) are monitoring and maintaining the machines. The employees 1508 and 1510 can view machine diagnostics and related notifications on display devices 1512 and 1514. Assume that the machine 1506 is broken and a warning notification has been sent to the central display 1516 for the employees 1508 and 1510 to review and act upon. If the warning notification is not reviewed and dismissed (e.g., by checking a done button displayed on the central display 1516) within a predetermined time, badge detection 906 and tag detection 908 are performed through antenna 1518 to search for nearby RFID badges (e.g., badges 1520 and 1522) and RFID tags (e.g., tags 1524 and 1526). A badge 1520 is associated with employee 1508 and a badge 1522 is associated with employee 1510. A tag 1524 is associated with display device 1512 and a tag 1526 is associated with display device 1514. When an employee, e.g., employee 1508, is determined to be nearby, an antenna 1518 searches for device tags, e.g., tag 1524, in the vicinity of employee 1508. A summarized notification is then issued to display device 1512 for employee 1508 to review. In some example implementations, center display 1516 may be associated with a tag 1528 and may be used for tag detection 908 for center display selection.

[0047] The above exemplary implementations may have various benefits and advantages, such as allowing users to attach authority and priority elements to notifications while maintaining the seriousness and urgency of the notification, and providing an infrastructure that follows appropriate predefined protocols for all aspects of contextualization, summarization, and interpretability.

[0048] 16 illustrates an exemplary computing environment having an exemplary computing device suitable for use in some exemplary implementations. The computing device 1605 in the computing environment 1600 can include one or more processing units, cores, or processors 1610, memory 1615 (e.g., RAM, ROM, and / or the like), internal storage 1620 (e.g., magnetic, optical, solid-state storage, and / or organic), and / or I / O interface 1625, any of which can be coupled over a communication mechanism or bus 1630 for communicating information or can be incorporated into the computing device 1605. The I / O interface 1625 is further configured to receive images from a camera or provide images to a projector or display, depending on the desired implementation.

[0049] The computing device 1605 may be communicatively coupled to an input / user interface 1635 and an output device / interface 1640. Either one or both of the input / user interface 1635 and the output device / interface 1640 may be a wired or wireless interface and may be removable. The input / user interface 1635 may include any device, component, sensor, or interface, physical or virtual, that can be used to provide input (e.g., buttons, touch screen interface, keyboard, pointing / cursor control, microphone, camera, Braille, motion sensor, accelerometer, optical reader, and / or the like). The output device / interface 1640 may include a display, television, monitor, printer, speaker, Braille, or the like. In some exemplary implementations, the input / user interface 1635 and the output device / interface 1640 may be incorporated with the computing device 1605 or may be physically coupled thereto. In other exemplary implementations, other computing devices may function as or provide the functionality of input / user interface 1635 and output device / interface 1640 for computing device 1605 .

[0050] Examples of computing devices 1605 may include, but are not limited to, highly mobile devices (e.g., smartphones, devices mounted on vehicles and other machines, devices carried by people or animals, and the like), mobile devices (e.g., tablets, notebooks, laptops, personal computers, portable televisions, radios, and the like), and devices not designed for mobility (e.g., desktop computers, other computers, information kiosks, televisions with one or more processors embedded and / or televisions with one or more processors coupled thereto, radios, and the like).

[0051] Computing device 1605 may be communicatively coupled (e.g., via I / O interface 1625) to external storage 1645 and a network 1650 for communication with any number of networked components, devices, and systems, including one or more computing devices of the same or different configurations. Computing device 1605 or any other connected computing device may function as, provide services to, or be referred to as a server, client, thin server, general purpose machine, special purpose machine, or otherwise.

[0052] I / O interface 1625 may include, but is not limited to, wired and / or wireless interfaces using any communication or I / O protocol or convention (e.g., Ethernet, 802.11x, Universal System Bus, WiMax, modem, cellular network protocols, and the like) for communicating information to and / or from at least all connected components, devices, and networks in computing environment 1600. Network 1650 may be any network or combination of networks (e.g., the Internet, a local area network, a wide area network, a telephone network, a cellular network, a satellite network, and the like).

[0053] The computing device 1605 can use and / or communicate using computer usable or computer readable media, including transitory and non-transitory media. Transitory media include transmission media (e.g., metallic cables, optical fibers), signals, carrier waves, and the like. Non-transitory media include magnetic media (e.g., disks and tapes), optical media (e.g., CD-ROMs, digital video disks, Blu-ray® disks), solid-state media (e.g., RAM, ROM, flash memory, solid-state storage), and other non-volatile storage or memory.

[0054] The computing device 1605 may be used to implement techniques, methods, applications, processes, or computer-executable instructions in some exemplary computing environments. The computer-executable instructions may be retrieved from a transitory medium and stored in and retrieved from a non-transitory medium. The executable instructions may be from one or more of any programming, scripting, and machine language (e.g., C, C++, C#, Java, Visual Basic, Python, Perl, JavaScript, etc.).

[0055] The processor 1610 can run under any operating system (OS) (not shown) in a native or virtual environment. One or more applications can be deployed, including a logic unit 1660, an application programming interface (API) unit 1665, an input unit 1670, an output unit 1675, and an inter-unit communication mechanism 1695 for different units to communicate with each other, with the OS, and with other applications (not shown). The above-mentioned units and elements can differ in design, function, configuration, or implementation, and are not limited to the above description. The processor 1610 can have the form of a hardware processor, such as a central processing unit (CPU), or can be a combination of hardware and software units.

[0056] In some exemplary implementations, when information or instructions for execution are received by the API unit 1665, it may be communicated to one or more other units (e.g., logic unit 1660, input unit 1670, output unit 1675). In some examples, logic unit 1660 may be configured to control information flow between units and direct services provided by API unit 1665, input unit 1670, output unit 1675 in some exemplary implementations described above. For example, one or more processes or implementation flows may be controlled by logic unit 1660 alone or in conjunction with API unit 1665. Input unit 1670 may be configured to obtain inputs for the calculations described in the exemplary implementations, and output unit 1675 may be configured to provide outputs based on the calculations described in the exemplary implementations.

[0057] The processor 1610 may be configured to automatically identify a person, as shown in Figures 4 and 9A-9D. The processor 1610 may also be configured to identify a display device that is closest to the person, as shown in Figures 4 and 9A-9D. The processor 1610 may also be configured to generate contextual information specific to the person, as shown in Figures 4 and 9A-9D. The processor 1610 may also be configured to display the contextual information on a display device viewed by the person, as shown in Figures 4 and 9A-9D.

[0058] The processor 1610 may be configured to analyze an event to detect the presence of a predefined event response to the event when the event is detected, as shown in Figures 2 and 3. The processor 1610 may be further configured to notify the closest person with permission to address the event when the predefined event response is detected, as shown in Figures 2 and 3, and provide an action solution to the closest person to address the event, where the person is identified as the closest person.

[0059] The processor 1610 may also be configured to create a new event response to address the event, the new event response including event information, an action to perform, and clearance information, the action including notifying the closest person with clearance to address the event. The clearance information is a required clearance level of the closest person, as shown in FIG. 2 and FIG. 3. The processor 1610 may also be further configured to notify the closest person with clearance to address the event and provide an action solution to the closest person to address the event, as shown in FIG. 2 and FIG. 3. The processor 1610 may also be configured to retrieve the person's primary location associated with the person's assigned activity from the route database, as shown in FIG. 9A-9D.

[0060] Some portions of the detailed description are presented in terms of algorithms and symbolic representations of operations within a computer. These algorithmic descriptions and symbolic representations are the means used by those skilled in the data processing arts to convey the substance of their innovations to others skilled in the art. An algorithm is a sequence of defined steps leading to a desired end state or result. In exemplary implementations, the steps performed require physical manipulations of tangible quantities to achieve a tangible result.

[0061] Unless otherwise noted, and as will be apparent from the description, throughout this specification, descriptions utilizing words such as "processing," "computing," "calculating," "determining," "displaying," or the like, are understood to include the actions and processes of a computer system or other information processing device that manipulates and converts data represented as physical (electronic) quantities in the registers and memory of the computer system into other data similarly represented as physical quantities in the memory or registers of the computer system or other information storage, transmission, or display devices.

[0062] Exemplary embodiments may further relate to an apparatus for performing the operations herein. The apparatus may be specially constructed for the desired purposes or may include one or more general-purpose computers selectively activated or reconfigured by one or more computer programs. Such computer programs may be stored in a computer-readable medium, such as a computer-readable storage medium or a computer-readable signal medium. A computer-readable storage medium may include tangible media, such as, but not limited to, optical disks, magnetic disks, read-only memory, random access memory, solid-state devices and drives, or any other type of tangible or non-transitory medium suitable for storing electronic information. A computer-readable signal medium may include media such as carrier waves. The algorithms and displays presented herein are not inherently related to any particular computer or other apparatus. A computer program may include a pure software implementation that includes instructions for performing the operations of a desired embodiment.

[0063] Various general-purpose systems may be used with the programs and modules according to the examples herein, or it may be convenient to construct specialized apparatus to perform the desired method steps. Additionally, the exemplary embodiments are not described with reference to any particular programming language. It will be understood that various programming languages ​​may be used to implement the teachings of the exemplary embodiments as described herein. Instructions of the programming language may be executed by one or more processing devices, such as, for example, a central processing unit (CPU), a processor, or a controller.

[0064] As is known in the art, the operations described above may be performed by hardware, software, or any combination of software and hardware. Various aspects of the exemplary embodiments may be implemented using circuits and logic devices (hardware), while other aspects may be implemented using instructions stored on a machine-readable medium (software) that, when executed by a processor, cause the processor to perform a method to perform the implementation of the present application. Furthermore, some exemplary embodiments of the present application may be implemented solely in hardware, while other exemplary embodiments may be implemented solely in software. Furthermore, various functions described may be performed in a single unit or may be distributed across multiple components in any number of ways. When implemented by software, the method may be executed by a processor, such as a general purpose computer, based on instructions stored on a computer-readable medium. If desired, the instructions may be stored on the medium in compressed and / or encrypted format.

[0065] Moreover, other implementations of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the teachings herein. Various aspects and / or components of the described exemplary implementations may be used alone or in any combination. It is intended that the specification and exemplary implementations be considered as examples only, with a true scope and spirit of the present application being indicated by the following claims. [Explanation of symbols]

[0066] 102 Event Detection Module 104 Participant Identification Module 106 Participant Location Determination Module 108 Display Decision Module 204 Predefined Auto-Responses 206 Event Response Database 208 Event Scribe Module 402 Summarization Technique Database 404 Display Technique Database 406 Employee Authority Calculation Unit 910 Employee Route Database 912 Display Location Database 1635 Input / User Interface 1640 Output Device / Interface 1645 External Storage 1650 Network 1605 Computing Devices 1625 I / O Interface 1620 Internal Storage 1615 Memory 1610 Processor 1660 Logical Units 1665 API unit 1670 Input Unit 1675 Output Unit

Claims

1. 1. An information processing method for generating and displaying context-based information, comprising: automatically identifying the person by a processor; An information processing method comprising: identifying, by the processor, a display device closest to the person; generating, by the processor, contextual information specific to the person; and displaying, by the processor, the contextual information on the display device viewed by the person.

2. 2. The information processing method according to claim 1, Automatically identifying the person is triggered by detection of an event; The person is identified as the person who will handle the event.

23. An information processing method comprising:

3. 3. The information processing method according to claim 2, if the event is detected, analyzing, by the processor, the event to detect the presence of a predetermined event response to the event; notifying, by the processor, a closest person having permission to address the event if the predetermined event response is detected, and providing an action solution to the closest person to address the event, wherein the person is identified as the closest person.

23. An information processing method comprising:

4. 4. The information processing method according to claim 3, if the predetermined event response is not detected, creating a new event response to address the event, the new event response including event information, an action to take, and clearance information, the action being to notify the closest person who has clearance to address the event, the clearance information being a required clearance level of the closest person; and notifying, by the processor, the closest person having permission to handle the event and providing the action resolution to the closest person for handling the event.

23. An information processing method comprising:

5. 2. The information processing method according to claim 1, automatically identifying the person includes identifying an employee who has authority to handle the event, the person being identified as the employee; generating the contextual information specific to the person, Computing at least one of a visual aid or text associated with the event; and Retrieving an employee authority associated with the person; and applying a summarization technique of a plurality of summarization techniques to the at least one of the visual aid or the text based on the employee authorization to generate the contextual information; determining a display technique among a plurality of display techniques for displaying the contextual information based on a display type of the display device; the plurality of display techniques include: graphically displaying information based on a display size; and controlling information display based on the display size; 23. An information processing method comprising:

6. 2. The information processing method according to claim 1, automatically identifying the person includes performing, by the processor, human recognition using a computer vision algorithm to detect the person among a plurality of people; Identifying a display device closest to the person includes performing object recognition, by the processor, to identify the display device from a plurality of display devices, the display device being closest to the person compared to the plurality of display devices; performing said person recognition is triggered by the occurrence of an event, and said person has a permission to handle said event; 23. An information processing method comprising:

7. 2. The information processing method according to claim 1, automatically identifying the person includes performing, by the processor, radio frequency identification (RFID) detection on RFID tags carried by a plurality of persons to identify the person among the plurality of persons.

23. An information processing method comprising:

8. 8. An information processing method according to claim 7, identifying a display device closest to the person includes performing, by the processor, at least one of object recognition or RFID detection to identify the display device from a plurality of display devices, the display device being closest to the person compared to the plurality of display devices; 23. An information processing method comprising:

9. 2. The information processing method according to claim 1, retrieving, by the processor, a primary location of the person associated with the assigned activity of the person from a route database; the display device is the closest display device in distance to the primary location; 23. An information processing method comprising:

10. 10. The information processing method according to claim 9, automatically identifying the person includes performing, by the processor, radio frequency identification (RFID) detection on an RFID tag carried by the person to identify the person's onsite presence.

23. An information processing method comprising:

11. 1. An information processing system for generating and displaying context-based information, comprising: A plurality of display devices; A processor, the processor comprising: Automatically identifying a person; identifying a display device of the plurality of display devices that is closest to the person; generating contextual information specific to the person; displaying the contextual information on the display device for viewing by the person; and An information processing system comprising:

12. The information processing system according to claim 11, Automatically identifying the person is triggered by detection of an event; The system of claim 11 , wherein the person is identified as a person who handles the event.

13. The information processing system according to claim 12, The processor, if the event is detected, analyzing the event to detect the presence of a predetermined event response to the event; and if the predetermined event response is detected, notifying a closest person having permission to address the event and providing an action solution to the closest person to address the event, the person being identified as the closest person. An information processing system comprising:

14. The information processing system according to claim 13, if the processor detects that the predetermined event response is not detected, creating a new event response to address the event, the new event response including event information, an action to take, and clearance information, the action being to notify the closest person who has clearance to address the event, the clearance information being a required clearance level of the closest person; and notifying the closest person having permission to handle the event and providing a solution to the action to the closest person for handling the event. An information processing system comprising:

15. The information processing system according to claim 11, the processor is configured to automatically identify the person by identifying an employee who has authority to handle the event, the person being identified as the employee; The processor, receiving at least one of a visual aid or text associated with the event; calculating an employee authority associated with the person; applying a summarization technique of a plurality of summarization techniques to the at least one of the visual aid or the text based on the employee authority to generate the contextual information; determining a display technique among a plurality of display techniques for displaying the contextual information based on a display type of the display device; and the plurality of display techniques include: graphically displaying information based on a display size; and controlling information display based on the display size; An information processing system comprising:

16. The information processing system according to claim 11, the processor is configured to automatically identify the person by performing human recognition using a computer vision algorithm to detect the person among a plurality of people; the processor is configured to identify the display device in proximity to the person by performing object recognition to identify the display device from among the plurality of display devices; performing said person recognition is triggered by the occurrence of an event, and said person has a permission to handle said event; An information processing system comprising:

17. The information processing system according to claim 11, the processor is configured to automatically identify the person by performing radio frequency identification (RFID) detection on RFID tags carried by a plurality of persons to identify the person among the plurality of persons; An information processing system comprising:

18. 18. The information processing system according to claim 17, the processor is configured to identify the display device in proximity to the person by performing at least one of object recognition or RFID detection to identify the display device among the plurality of display devices. An information processing system comprising:

19. The information processing system according to claim 11, the processor is further configured to retrieve a primary location of the person associated with the assigned activity of the person from a route database; the display device is the closest display device in distance to the primary location; An information processing system comprising:

20. 20. The information processing system according to claim 19, the processor is configured to automatically identify the person by performing radio frequency identification (RFID) detection on an RFID tag carried by the person to identify the person's onsite presence; An information processing system comprising:

Images