Associating a content item with a captured image of the meeting content

By creating associations between images and content items, the problem of inconvenience of users finding and using content items during the meeting content capture process is solved, and a more efficient content capture and management experience is achieved.

CN114846493BActive Publication Date: 2025-08-19MICROSOFT TECHNOLOGY LICENSING LLC
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202080083403.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-12-05
Filing Date
2020-11-06
Publication Date
2025-08-19
Estimated Expiration
2040-11-06

AI Technical Summary

Technical Problem

In the prior art In the process of capturing conference content, it is difficult for users to quickly find and use the basic content items presented as conference content, resulting in poor capture and management experience.

Method used

By identifying the content source of the conference in the scene image by computing devices, creating associations between the image and content items, such as embedding links in an image file or association with content items, simplifying access to content items.

Benefits of technology

Improves users' ability to quickly access and use related content items from images, reduces navigation steps, and improves the efficiency of capturing and managing content.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114846493B_ABST
    Figure CN114846493B_ABST
Patent Text Reader

Abstract

Disclosed herein are systems, methods, and software for associating an image with a content item. In one embodiment, a computing device determines that a captured image of a scene includes a display of conference content. The device identifies a content item that includes a conference content source in the scene and can then create an association between an instance of the image and an instance of the content item. For example, the device can create a link to the content item, which can be embedded in an image file or otherwise associated with the image file. The reverse operation can also be implemented, whereby a link to an image can be created and embedded in a content item or otherwise associated with the content item.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Some aspects of the present disclosure relate to the field of computing devices and software applications, and in particular, to enhancing the content capture experience in meetings. Background Art

[0002] Various content capture technologies allow users to capture meeting content for later reference and understanding. Some solutions are built into a given meeting environment, such as the ability to record audio and / or video exchanged during an online meeting, as well as screen sharing of various participants. Other capture methods can be used in a more ad hoc manner, such as when a user takes a photo of whiteboard content.

[0003] Along similar lines, meeting participants often take photos of digital content displayed in the context of a meeting. For example, a user can take a photo of a slideshow or capture a screenshot of a slideshow being presented to meeting participants on a display screen. The resulting image is then saved in one of many suitable file formats (e.g., JPEG, BMP, and GIF) and can be viewed, shared, etc. Summary of the Invention

[0004] The computing device is software disclosed herein that enhances the content capture experience by linking presented content items to images captured by users from them. This advancement improves the ability of users to find and use content items that serve as the basis for conference content presentation.

[0005] In one or more embodiments, a computing device determines that a captured image in a scene includes a display of conference content. The device identifies a content item in the scene that includes the conference content source and can then create an association between an instance of the image and an instance of the content item. For example, the device can create a link to the content item, which can be embedded in the image file or otherwise associated with the image file. The reverse operation can also be implemented, whereby a link to the image can be created and embedded in the content item or otherwise associated with the content item.

[0006] This summary is provided to introduce a selection of design concepts further described below in the detailed description in a simplified form. It is understood that this summary is not intended to identify key features or important features of the claimed subject matter, nor is it intended to limit the scope of the claimed subject matter. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Many aspects of the present disclosure may be better understood with reference to the following drawings. The components in the drawings are not necessarily drawn to scale, but rather are intended to clearly illustrate the principles of the present disclosure. Additionally, similar reference numerals in the drawings indicate corresponding parts throughout the various views. Although several embodiments have been described in conjunction with these drawings, the present disclosure is not limited to the embodiments disclosed herein. Rather, it is intended to encompass all alternatives, modifications, and equivalents.

[0008] Figure 1 An operation scenario in an embodiment is shown.

[0009] Figure 2 A content association process in one embodiment is shown.

[0010] Figure 3 A user experience in one embodiment is shown.

[0011] Figure 4 A user experience in one embodiment is shown.

[0012] Figure 5 A user experience in one embodiment is shown.

[0013] Figure 6 A computing system suitable for implementing the various operating environments, user experiences, architectures, processes, scenarios, and sequences discussed below with respect to the figures is shown. DETAILED DESCRIPTION

[0014] Aspects of the present disclosure relate to computing technologies that enhance user experiences with content capture and retrieval. In various implementations, a computing device captures an image of a scene and determines whether the image includes a display of meeting content. For example, a user in a meeting can take a photo of a slideshow presented on a monitor in a conference room, and the device can identify that the scene includes content. The device can then identify content items that are sources of the meeting content in the scene, allowing associations to be created between the image and the content item, thereby improving the accessibility of the content item.

[0015] In some embodiments, creating an association between the image and the content item may include embedding a link to the content item in the image. Determining that the image of the scene includes displaying meeting content may be accomplished by applying a content recognition algorithm to at least a portion of the image. The content recognition algorithm may include a machine learning model configured based on training data representing other images classified as displaying other meeting content.

[0016] In the same or other embodiments of the system, identifying the content item may include searching a data repository for the content item based on search criteria associated with the image. The content item may include a file formatted according to a presentation format, a word processing document format, or a spreadsheet workbook format. In some cases, the meeting content may include a visual rendering of the file. The data repository may include cloud storage, and to search the data repository, the program instructions instruct the one or more processors to remotely call the cloud storage using the search criteria.

[0017] These and other features and characteristics of the technology herein, as well as the methods of operation and function of the structurally related elements and the combination of parts and economy of manufacture, will become more apparent upon consideration of the following description and appended claims with reference to the accompanying drawings, all of which form a part of this specification, wherein like reference numerals designate corresponding parts in the various figures. It is to be expressly understood, however, that the drawings are for purposes of illustration and description only and are not intended as a definition of the limits of the claims.

[0018] Referring now to the accompanying drawings, Figure 1 1 shows an operating environment 100 and a computing device 101 in one embodiment. Examples of computing device 101 include, but are not limited to, mobile phones, tablet computers, laptop computers, desktop computers, wearable devices (such as watches and glasses), Figure 6 The computing device 601 in FIG. 1 is representative thereof. The computing device 101 uses the content association process 200, which can be implemented in hardware, software, firmware, or any combination thereof. Figure 2 , computing device 101 operates as follows when executing content association process 200 .

[0019] In operation, computing device 101 captures, receives, or otherwise obtains an image 111 of a scene (step 201). The scene includes a display device 105 affixed to a wall 103, such as in a conference room. The wall also includes a whiteboard 107, which is not captured in the image. Computing device 101 captures the image using its integrated camera. Alternatively, an external camera connected to computing device 101 can capture the image, as can a remote camera. In both cases, computing device 101 can be understood as capturing the image by receiving images captured by both the external and remote cameras.

[0020] The computing device 101 that has captured, received, or otherwise obtained the image 111 determines that the image of the scene includes a display of conference content (step 203). Examples of content include electronic slide presentations (e.g., slide layouts), word processing documents, electronic spreadsheet workbooks, text messages, chat room messages, blog posts, microblog posts, social network posts, or any other digital content that can be displayed. The content can be displayed on a conference room monitor, a computer monitor, or a phone screen, projected onto a display surface, or visually rendered in any other suitable manner. In this scenario, the display device 105 displays slides 106 from the slide presentation.

[0021] Computing device 101 can determine that an image of a scene includes meeting content in a variety of ways. For example, computing device 101 (or a remote service) can employ a content recognition algorithm to determine that content is displayed in the scene. In other examples, user input can be used to indicate or notify computing device 101 that the scene includes the display of content. In other examples, explicit determination that the scene includes content can be avoided. Instead, computing device 101 can implicitly determine that the scene includes content, or can assume its presence.

[0022] Next, computing device 101 extracts identifying information about the content (step 205). The information can be extracted from one or more of the following: the image itself, the context of the image, and user input. For example, computing device 101 can use a character recognition algorithm to extract text from the image. The date, time, and / or location can be extracted from image file metadata or from other aspects of the operating environment. With respect to user input, spoken utterances can be transcribed and parsed to identify information. Computing device 101 can use local resources, remote resources, or a combination of local and remote resources to extract identifying information.

[0023] Using the identification information, computing device 101 proceeds to search for a content item that is the source of the content displayed in the scene (step 207). This can be accomplished by searching one or more of data stores 117, 118, and 119 using the identification information associated with a given content item. Non-limiting examples of identification information include text and / or objects extracted from an image of the content item, event information associated with one or more scheduled events that overlap with the time and date of image capture, and information extracted from a transcription of the spoken utterance. Non-limiting examples of data stores include an email mailbox, a digital calendar, a file repository, cloud storage, a message repository, chat messages, a microblog, a collaboration site, a social network, and the like.

[0024] After identifying one or more content items, computing device 101 proceeds to associate the instance of the image of the scene with the one or more content items (step 209). This can be achieved in a variety of ways, such as by adding metadata to the image file (step 209A), updating the association list (step 209B), or creating a container file (step 209C). For example, a link to a given content item can be embedded in the image (or a copy of the image) so that the user can navigate to the content item by touching, clicking, or otherwise selecting the embedded link. The metadata for the embedded link can be stored in the image file itself, or can be maintained separately from the image data used to render the image. In another example, a list or other such separate data structure can be maintained that includes metadata detailing the association between the content items and the image. In a container scenario, a single data structure (e.g., a container file) can be created that stores the image file and one or more associated content items.

[0025] The association 115 of image 111 with content item 113 produces various technical effects. Association 115 allows the user to easily open and use the content item from the location of the image, reducing the number of steps that would otherwise be performed to search for, navigate to, and open the content item. In a similar manner, the association 115 of image 111 with content item 133 can allow the user to more easily open and use image 111 from the location of the content item. In some (but not all) cases, the reduction in steps can reduce power consumption, improve battery life, and otherwise improve the performance of a given device. In any case, such advancements improve the user experience when creating, capturing, and managing content.

[0026] Figure 3 FIG3 illustrates a user experience 300 in one embodiment with respect to a computing device 301. Examples of computing device 301 include, but are not limited to, mobile phones, tablet computers, laptop computers, desktop computers, and wearable devices (e.g., watches and glasses). Figure 6 The computing device 601 in FIG. 3 is a representative thereof. The computing device 301 includes a display 303 capable of displaying a user interface and receiving user input. The computing device 301 may include other components, such as a microphone component, a speaker component, a camera component, and the like.

[0027] User experience 300 begins with user interface 310 appearing on display 303. User interface 310 includes various controls for interacting with the camera application. The controls include a capture button 311, a gallery button 313, and directional buttons 315. User interface 310 also includes various options for changing modes (e.g., video, photo, and slow motion). Capture button 311 can be pressed to capture an image of the scene viewed by the camera assembly of computing device 301, while gallery button 313 provides a mechanism for navigating to a gallery view of images stored on the device. Direction buttons 315 allow the user to change which camera subassembly (front or back) is used to take a photo.

[0028] The user interface 310 in this example also includes a live image 317 of the scene captured via the camera component (and front-facing subcomponent) of the computing device 301. When the user input 319 includes a selection of the capture button 311, the live image can be retained as a captured image. The captured version of the image can then be viewed by navigating directly to the image, through an image library, or in some other manner. When doing so, the display 303 transitions from the user interface 310 to the user interface 320.

[0029] The user interface 320 includes various controls for interacting with the captured image 325 displayed in the function menu 321 and the function menu 323. The function menu 321 includes a button for navigating back to the gallery, a button for liking an image, and a button for navigating to a submenu. The function menu 323 includes an image recognition button, an edit button, a share button, and a trash button.

[0030] During or after the image is captured, computing device 301 employs a process that is the same as or similar to content association process 200 to identify content and associate the content with the image. A link to the content can be embedded in the image so that an instance of the link can be presented in user interface 320. Icon 327 in user interface 320 is one example of an instance of a link that can be displayed in association with captured image 325.

[0031] Icon 327 links to a slideshow presentation determined by computing device 301 to be associated with captured image 325. Figure 1 Similarly to the example provided, captured image 325 in user experience 300 includes slideshow content displayed on a display device. This fact is recognized by the content association process employed by computing device 301. The associated slideshow presentation is accordingly identified and a link to it is displayed in a stacked fashion in user interface 320. Icon 327 comprises an active link to the slideshow presentation, such that user input 329, including selection of the icon, causes computing device 301 to launch a presentation application and open the slideshow presentation in user interface 330.

[0032] User interface 330 is an example of an application environment in which a slide presentation, word processing document, spreadsheet, or other such content can be opened. User interface 330 in this example includes a function menu 331 for interacting with the slide presentation and various controls in function menu 333. Function menu 331 includes a back button, an edit button, a search button, and a play button. Function menu 333 includes controls for navigating from the presentation application to other aspects of the local environment.

[0033] User interface 330 also includes preview versions of the various slides in the slideshow presentation, represented by slide 334, slide 336, and slide 338. Touching or otherwise selecting the play button in function menu 331 causes the slideshow to be displayed in full-screen mode, one slide at a time. It will be appreciated that slide 336 corresponds to the content displayed by the display screen in captured image 325 of the scene. Thus, the user can easily navigate to the slideshow presentation directly from the view of captured image 325, without having to navigate elsewhere to search for the presentation and / or open it.

[0034] Figure 4 Another user experience 400 in one embodiment is shown. User experience 400 involves a computing device 401, of which computing device 601 is representative. Examples include, but are not limited to, mobile phones, tablet computers, laptop computers, desktop computers, and wearable devices (e.g., watches and glasses). Computing device 301 includes a display 303 capable of displaying a user interface and receiving user input. Computing device 301 may include other components, such as a microphone assembly, a speaker assembly, a camera assembly, and the like.

[0035] User experience 400 includes a user interface 410 for a photo gallery presented by display 403. User interface 410 includes a grid of image previews 411-418, some of which include links to content items associated with the images. For example, image preview 411 does not include a link, while image preview 412 includes a file icon 422 that links to a corresponding content item (e.g., a word processing document). The content item will be determined to be related to the content captured in the image previewed by image preview 412, while the image following image preview 411 will be determined to lack content associated with the content item. Similarly, image preview 413 lacks an embedded icon, while image preview 414 includes a file icon 424 that links to a slide presentation. Slide previews 415, 417, and 418 also lack any such links.

[0036] In operation, a user provides user input 425, including selection of a file icon 424. Selection of the file icon 424, which is linked to a slideshow presentation, causes the computing device 401 to present a preview 430 of the slideshow presentation in the user interface 410. The preview displays a portion of the slides in the slideshow presentation, including slide 431. Slide 431 is notable as the source of the content captured in the image following the image preview 414.

[0037] User input 435, including selecting preview 430, causes computing device 401 to open the full slideshow presentation associated with the preview. The slideshow presentation opens in a user interface 440 of a presentation application. User interface 440 includes a function menu 441 and various controls in function menu 443 for interacting with the slideshow presentation, such as a back button, an edit button, a search button, and a play button in function menu 441, as well as controls for navigating from the presentation application to other aspects of the local environment in function menu 443.

[0038] User interface 440 also includes previews or minimized versions of the various slides in the slideshow presentation, represented by slide 444, slide 446, and slide 448. Touching or otherwise selecting the play button in function menu 441 will cause the slideshow to be displayed in full-screen mode, one slide at a time. It will be understood that slide 446 corresponds to the content captured in the image behind image preview 414. As can be understood from user experience 400, the user can easily navigate to the slideshow presentation without having to navigate elsewhere to search for the presentation and / or open it. In addition, the user can navigate to the slideshow presentation from a gallery preview of the captured image, reducing the need to have to open the image before interacting with the file icon linked to the presentation.

[0039] Figure 5 5. User experience 500 in FIG. 5 shows a scenario where a content item includes a link to an image, as opposed to an image having a link to the content item. In operation, computing device 501 includes a user interface 505 for a most recently used (MRU) list of content items. The MRU list includes a presentation graphic 511, a presentation graphic 513, and a presentation graphic 515. Each presentation graphic can be touched, clicked, or otherwise selected to open its underlying slide presentation. User interface 505 also includes a function menu 508 for searching and opening new presentations, and a function menu 504 for navigating to other aspects of the computing environment.

[0040] In addition, presentation graphics 511 and 515 include photo icons 521 and 525, respectively, that link to images associated with the content items. User input 527, including selection of photo icon 521, causes computing device 501 to open its corresponding image to an image viewer in user interface 540. User interface 540 includes a function menu 541 with options for interacting with the image, and a function menu 543 with options for navigating to other aspects of the local computing environment. It will be appreciated that the images in user interface 540 capture the display 545 of the content, which in this example is a slide from a slide presentation displayed on the screen.

[0041] User interface 540 also includes a file icon 547 that links to a slideshow presentation that includes the source of the slideshow displayed on the screen. That is, computing device 501 (or some other device) previously determined that the image includes a depiction of a content display and that the slideshow presentation is the source of that content. Therefore, file icon 547 corresponds to the slideshow presentation, and selecting file icon 547 will cause computing device 501 to open the slideshow presentation in the context of an appropriate application.

[0042] Continuing with user experience 500, user input 529 includes selection of photo icon 525, which causes computing device 501 to open a corresponding image file in user interface 540. It will be appreciated that the image in user interface 540 captures a display 555 of content, which in this example is a slide from a slide presentation displayed on a monitor.

[0043] In this example, user interface 540 includes a file icon 547 that links to a slideshow presentation that includes the source of the slideshow displayed on the screen. That is, computing device 501 (or some other device) previously determined that the image includes a depiction of a content display and that the slideshow presentation is the source of that content. Therefore, file icon 547 corresponds to the slideshow presentation, and selecting file icon 547 will cause computing device 501 to open the slideshow presentation in the context of an appropriate application.

[0044] Figure 6 A computing device 601 is shown, which represents any device or collection of devices in which the various processes, programs, services, and scenarios disclosed herein may be implemented. Examples of computing device 601 include, but are not limited to, mobile phones, tablet computers, laptop computers, desktop computers, watches and other wearable devices, and Internet of Things (IoT) devices. Some or all aspects of the various processes, programs, services, and scenarios disclosed herein may also be implemented on server computers, cloud computing platforms, and data center equipment, as well as any other type of physical or virtual server machines, containers, and any variations or combinations thereof.

[0045] Computing device 601 can be implemented as a single device, system, or apparatus, or can be implemented as multiple devices, systems, or apparatuses in a distributed manner. Computing device 601 includes, but is not limited to, a processing system 608, a storage system 603, software 605, a communication interface system 607, and a user interface system 609. Processing system 608 is operatively coupled to storage system 603, communication interface system 607, and user interface system 609.

[0046] Processing system 608 loads and executes software 605 from storage system 603. Software 605 includes and implements content association process 606, which is representative of the content association process discussed with respect to the previous figures. When executed by processing system 608 to enhance the user experience with respect to the content capture experience, software 605 directs processing system 608 to operate as described herein, at least with respect to the various processes, operational scenarios, and sequences discussed in the preceding embodiments. Computing device 601 may optionally include additional devices, features, or functionality not discussed for the sake of simplicity.

[0047] Still refer to Figure 6 , processing system 608 may include a microprocessor and other circuitry that retrieves and executes software 605 from storage system 603. Processing system 608 may be implemented in a single processing device, but may also be distributed among multiple processing devices or subsystems that cooperate to execute program instructions. Examples of processing system 608 include general-purpose central processing units, graphics processing units, special-purpose processors and logic devices, and any other type of processing device, combination thereof, or variation thereof.

[0048] The storage system 603 may include any computer-readable storage medium that is readable by the processing system 608 and capable of storing the software 605. The storage system 603 may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Examples of storage media include random access memory, read-only memory, magnetic disks, optical disks, flash memory, virtual and non-virtual memory, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other suitable storage medium. A computer-readable storage medium is not a propagated signal in any way.

[0049] In addition to computer-readable storage media, in some embodiments, storage system 603 may also include computer-readable communication media through which at least some of software 605 may be transmitted internally or externally. Storage system 603 may be implemented as a single storage device, but may also be implemented on multiple storage devices or subsystems that are co-located or distributed relative to each other. Storage system 603 may include additional units, such as a controller capable of communicating with processing system 608 or possibly other systems.

[0050] The software 605 (including the content association process 606) may be implemented in program instructions and, when executed by the processing system 608, may direct the processing system 608 to operate as described for the various operational scenarios, sequences, and processes described herein, as well as to perform other functions. For example, the software 605 may include program instructions for implementing the content association process described herein.

[0051] In some embodiments, the software 605 may include a plurality of program instructions, such as a program command, a program instruction, a program command for executing the program, a program command for performing the program ...

[0052] Generally speaking, when loaded into processing system 608 and executed, software 605 can transform a suitable device, system, or apparatus (represented by computing device 601) generally from a general-purpose computing system into a specialized computing system customized to provide enhanced content capture capabilities. Indeed, the encoded software 605 on storage system 603 can transform the physical structure of storage system 603. The specifics of the physical structure may depend on various factors in different implementations of this specification. Examples of such factors may include, but are not limited to, the technology of the storage medium used to implement storage system 603, whether the computer storage medium is characterized as primary or secondary storage, and other factors.

[0053] For example, if the computer-readable storage medium is implemented as a semiconductor-based memory, then when program instructions are encoded in software 605, software 605 can transform the physical state of the semiconductor memory, for example, by transforming the state of transistors, capacitors, or other discrete circuit elements that make up the semiconductor memory. Similar transformations can occur for magnetic or optical media. Other transformations of the physical medium are possible without departing from the scope of this specification, and the foregoing examples are provided only to facilitate this discussion.

[0054] The communication interface system 607 may include communication connections and devices that allow communication with other computing systems (not shown) via a communication network (not shown). Examples of connections and devices that together allow communication between systems may include: network interface cards, antennas, power amplifiers, RF circuits, transceivers, and other communication circuits. The connections and devices may communicate over a communication medium (such as metal, glass, air, or any other suitable communication medium) to exchange communications with other computing systems or system networks. The above-mentioned media, connections, and devices are well known and need not be discussed in detail here.

[0055] Communication between computing device 601 and other computing systems (not shown) can occur over a communication network or networks and according to various communication protocols, combinations of protocols, or variations thereof. Examples include an intranet, the internet, a local area network, a wide area network, a wireless network, a wired network, a virtual network, a software-defined network, a data center bus, and a backplane, or any other type of network, combination of networks, or variations thereof. The above-mentioned communication networks and protocols are well known and need not be discussed in detail herein.

[0056] The user interface system 609 may include a keyboard, a mouse, a voice input device, a touch input device for receiving touch gestures from a user, a motion input device for detecting non-touch gestures and other movements of a user, and other comparable input devices, as well as an associated processing unit capable of receiving user input from a user. Output devices such as displays, speakers, tactile devices, and other types of output devices may also be included in the user interface system 609. In some cases, input devices and output devices may be combined in a single device (such as a display capable of displaying images and receiving touch gestures). The above-mentioned user input and output devices are well known in the art and need not be discussed in detail here.

[0057] The user interface system 609 may also include associated user interface software that can be executed by the processing system 602 to support the various user input and output devices discussed above. Alone or in combination with each other and other hardware and software elements, the user interface software and user interface devices may support a graphical user interface, a natural user interface, a conversational user interface, or any other type of user interface.

[0058] As will be appreciated by those skilled in the art, aspects of the present invention may be embodied as a system, method, or computer program product. Thus, aspects of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, microcode, etc.), or an embodiment combining software and hardware aspects, which may all generally be referred to herein as a "circuit," "module," or "system." Additionally, aspects of the present invention may take the form of a computer program product embodied in one or more computer-readable media having computer-readable program code embodied thereon.

[0059] The included description and drawings depict specific embodiments in order to teach those skilled in the art how to make and use the best mode. For the purpose of teaching the principles of the invention, some conventional aspects have been simplified or omitted. Those skilled in the art will appreciate variations of these embodiments that fall within the scope of this disclosure. Those skilled in the art will also appreciate that the above-described features may be combined in various ways to form multiple embodiments. Therefore, the present invention is not limited to the specific embodiments described above, but is defined only by the claims and their equivalents.

Claims

1. A computing device comprising: one or more computer-readable storage media; one or more processors operatively coupled to the one or more computer-readable storage media; as well as Program instructions, stored on the one or more computer-readable storage media, which, when executed by the one or more processors, direct the computing device to perform at least the following operations: obtaining an image of the scene of the meeting; determining, via a machine learning model configured based on training data, that the obtained image of the scene of the meeting includes a display of meeting content, the training data including other images classified as including displays of other meeting content; extracting identification information of the conference content from the obtained image of the conference scene; searching for content items comprising a source of the conference content in the scene using the identification information; as well as An association is created between the instance of the image and the content item.

2. The computing device according to claim 1, wherein: To create the association between the image and the content item, the program instructions direct the computing device to embed a link to the content item in the image.

3. The computing device according to claim 1, wherein: To identify the content item of the source comprising the meeting content, the program instructions direct the computing device to search a data repository for the content item based on search criteria associated with the image.

4. The computing device of claim 3, wherein: The content item comprises a file formatted according to a presentation format, a word processing document format, or a spreadsheet workbook format; and The meeting content includes a visual rendering of the document.

5. The computing device of claim 4, wherein: The search criteria include the date and time of the image; The data repository includes an events calendar; and The files include attachments to events in the event calendar.

6. The computing device of claim 4, wherein: The search criteria include the date and time of the image; The data repository includes an email mailbox; and The files include attachments to emails in the email mailbox.

7. The computing device of claim 4, wherein: The search criteria include information extracted from the image; The data repository includes file storage; and The file comprises one of a plurality of files stored in the file store.

8. A method for operating a computing device, the method comprising: obtaining an image of the scene of the meeting; determining, via a machine learning model configured based on training data, that the obtained image of the scene of the meeting includes a display of meeting content, the training data including other images classified as including displays of other meeting content; extracting identification information of the conference content from the obtained image of the conference scene; searching for content items of a source comprising the conference content using the identification information; as well as An association is created between the instance of the image and the content item.

9. The method according to claim 8, wherein Creating the association between the image and the content item includes embedding a link to the content item in the image.

10. The method according to claim 8, wherein Identifying the content item includes searching a data repository for the content item based on search criteria associated with the image.

11. The method according to claim 10, wherein: The content item comprises a file formatted according to a presentation format, a word processing document format, or a spreadsheet workbook format; and The meeting content includes a visual rendering of the document.

12. The method according to claim 11, wherein The data repository comprises cloud storage, and wherein searching the data repository comprises making a remote call to the cloud storage using the search criteria.

13. The method according to claim 11, wherein The search criteria include a date and time of the image, the data repository includes an events calendar, and the files include attachments to events in the events calendar.

14. The method according to claim 11, wherein The search criteria include a date and time of the image, the data repository includes an email mailbox, and the files include attachments to emails in the email mailbox.

15. The method according to claim 11, wherein The search criteria includes information extracted from the image, the data repository includes a file store, and the file includes one of a plurality of files stored in the file store.

Citation Information

Patent Citations

  • Information processing system and information processing method

    US20070041666A1

  • Inline content file item attachment

    US20180373724A1