ELECTRONIC DEVICE AND METHOD FOR SELECTING AND DISPLAYING MULTIMODAL CONTENT - Patent application

The described system addresses the limitation of single audio file association by determining and displaying multimodal content based on user preferences, enhancing the user experience with personalized audio or video playback.

JP7595147B2Active Publication Date: 2024-12-05DIRECT OFFER INC
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2023502951
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-07-27
Filing Date
2021-07-26
Publication Date
2024-12-05
Estimated Expiration
2041-07-26

AI Technical Summary

Technical Problem

Existing digital devices lack the capability to associate and display multiple audio or video files with images, limiting the user's ability to view additional multimodal content related to the first multimedia content type.

Method used

A software-implemented apparatus and method that determines and provides multimodal content to a user based on their demographic or psychographic information, allowing users to interact with graphical user interface elements to trigger playback of relevant audio or video content in response to their preferences.

Benefits of technology

Enables personalized display of multimodal content, such as audio or video, associated with multimedia content, enhancing user experience by providing additional information tailored to individual preferences and demographics.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007595147000001
    Figure 0007595147000001
  • Figure 0007595147000002
    Figure 0007595147000002
  • Figure 0007595147000003
    Figure 0007595147000003
Patent Text Reader

Abstract

A software-implemented method for providing digital multimodal content to a first user of an electronic device is disclosed. The method includes displaying digital multimedia content to the first user and determining the digital multimodal content to be provided to the first user based on the first user's demographic information, psychographic information, or preferences. The method can include receiving input from the first user on a graphical user interface element displayed with the multimedia content and triggering playback of the digital multimodal content in response to the first user performing an action on the graphical user interface element. The method has particular advantages as a way to provide a customized user experience regarding a potential or possible real estate transaction.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an apparatus and method that facilitates the creation and display of nearly custom targeted digital content in a presentation context. [Background technology]

[0002] Conventional digital cameras, cell phones / smartphones, and other image capture devices capable of recording audio are now ubiquitous. These devices allow users to capture images to generate image files, and record audio content that can be attached to the image files. Information (called "metadata") such as the date of recording, the location of recording, the name of the photographer, a description of the event, and other information can be recorded, stored, and associated with the audio, visual, or video files. However, these devices have limitations. For example, existing devices only allow one audio file to be attached per image. This means that if you want to append an audio recording to an existing audio file, a conventional digital camera will erase the existing audio file and replace it with the appended audio information. Summary of the Invention [Problem to be solved by the invention]

[0003] Thus, current technology does not provide any means for a user to view additional multimodal content (audio, visual, or video) related to a first multimedia content type.

[0004] Further limitations and drawbacks of conventional and prior approaches will become apparent to those skilled in the art through comparison of the described system with certain aspects of the present disclosure, as described in the remainder of this application and with reference to the drawings. [Means for solving the problem]

[0005] According to embodiments provided herein, there is a software-implemented apparatus and method for providing content to a first user. The method may include displaying digital content to a first user and determining multimodal content to be provided to the first user based on at least one aspect of the first user, such as, for example, the first user's psychographic preferences (e.g., real estate preferences) or demographic preferences. The method may also include receiving input from the first user on a graphical user interface element displayed with the digital content, and triggering playback of the determined multimodal content in response to the user performing one or more input actions, such as touching (e.g., hovering, clicking, and double-clicking) the graphical user interface element.

[0006] The invention may be embodied as a system including an electronic device having one or more processors configured to provide multimodal content to a first user and to determine the multimodal content to be provided to the first user based on at least one aspect of the first user, such as demographic or psychographic information, or the first user's preferences related to real estate, etc. The device may also trigger playback of the determined multimodal content via software executing on the at least one processor.

[0007] The accompanying drawings illustrate various embodiments of the systems, methods, and other aspects of the present disclosure. Those skilled in the art will appreciate that the illustrated element boundaries (e.g., boxes, groups of boxes, or other shapes) in the figures represent one example of a boundary. In some examples, an element may be designed as multiple elements, or multiple elements may be designed as an element. In some examples, an element shown as an internal component of one element may be implemented as an external component of another element, and vice versa. Additionally, elements may not be drawn to scale.

[0008] Various embodiments are hereinafter described with reference to the drawings, which are provided for illustration purposes and not to limit the scope in any way, and in which like designations indicate like elements. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram illustrating a system environment in which various embodiments of the present methods and systems may be implemented. [Diagram 2] FIG. 1 is a block diagram illustrating an electronic device configured to provide multimodal content to a first user. [Figure 3A] FIG. 1 illustrates a user interface configured to display digital content and multimodal content to a first user. [Figure 3B] FIG. 1 illustrates a user interface configured to display digital content and multimodal content to a first user. [Figure 4] FIG. 13 illustrates a user interface displayed to a second user for multimodal content recording. [Diagram 5] 1 is a flow chart illustrating a method for providing multimodal content to a first user on an electronic device. [Figure 6] 1 is a block diagram of a computer system according to the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] The present disclosure may be best understood by referring to the detailed figures and descriptions set forth herein. Those skilled in the art will readily appreciate that the detailed description given herein with respect to the figures is for illustrative purposes, as the method and system may extend beyond the described embodiments. For example, the teachings presented and the needs of a particular application may result in multiple alternative and suitable approaches for implementing the functionality of any details described herein. Thus, any approach may extend beyond the specific implementation options in the following embodiments described and shown.

[0011] References to "one embodiment," "at least one embodiment," "one embodiment," "one example," "one embodiment," "for example," and the like indicate that an embodiment or example may include a particular feature, structure, attribute, property, element, or limitation, but not all embodiments or examples necessarily include that particular feature, structure, attribute, property, element, or limitation. Moreover, repeated use of the phrase "in one embodiment" does not necessarily refer to the same embodiment.

[0012] 1 is a block diagram illustrating an exemplary system environment 100. The system environment 100 typically includes an electronic device 102, a database server 104, and a communication network 106. The electronic device 102 and the database server 104 are typically communicatively coupled to each other via the communication network 106. In one embodiment, the electronic device 102 may communicate with the database server 104 using one or more protocols, such as, but not limited to, Open Database Connectivity (ODBC) and Java Database Connectivity (JDBC).

[0013] The electronic device 102 may refer to a computing device used by a first user. In one embodiment, the first user may be a user interested in viewing digital multimedia content, such as real estate images and / or videos. The electronic device 102 may comprise one or more processors and one or more memory units (aka "memories"). The one or more memories may include computer readable code executable by the one or more processors to perform certain operations. In one embodiment, the electronic device 102 presents a user interface to the first user for providing digital content to the first user. Examples of electronic devices in general and the electronic device 102 may include, but are not limited to, a personal computer, a laptop, a personal digital assistant (PDA), a tablet, a smartphone, or a mobile device, which may include a smart watch, such as an Apple Watch®, or any other computing device.

[0014] The electronic device 102 is preferably configured to provide digital multimodal content (aka "digital content") to a first user, where the digital content may originate from multiple users. The electronic device 102 may be configured to determine the multimodal content provided to the first user based on at least one of the first user's demographic or psychographic information, such as real estate preferences. The electronic device 102 may be configured to receive input from the first user on a graphical user interface element displayed with the digital multimedia content. Preferably, the input corresponds to the first user performing one or more actions on the graphical user interface element. The electronic device 102 may be configured to trigger playback of the determined digital multimodal content in response to the user performing one or more actions, such as hovering, clicking, double clicking, etc., on the graphical user interface element.

[0015] The database server 104 may refer to a computing device configured to store demographic and psychographic information and preferences, including real estate preferences, of each of a plurality of users. The database server 104 includes a dedicated operating system specifically configured to perform one or more database operations on multimedia content. Examples of database operations may include, but are not limited to, select, insert, update, push, pull, and delete. Preferably, the database server 104 includes hardware that may be configured to perform one or more predefined operations. The database server 104, and database servers in general, may be realized by various technologies, such as, but not limited to, Microsoft® SQL Server or Access® or Azure®, Oracle®, IBM DB2®, PostgreSQL®, MySQL®, and SQLite®.

[0016] The database server 104 may be configured to transmit, via the communication network 106, each user's demographic and / or psychographic information and each user's preferences to the electronic device 102 for data processing. Additionally, the database server 104 may be configured to store digital multimodal content recorded for multiple users, and may be configured to store digital multimedia content. The stored content may then be transmitted to the electronic device 102 for display to the first user. Furthermore, such stored digital multimedia content may be provided to a second user, such as a real estate agent or a marketer, who may also record the digital content.

[0017] Those skilled in the art will appreciate that the scope of the present disclosure is not limited to the database server 104 as a separate entity. In one embodiment, the functionality of the database server 104 may be integrated into the electronic device 102.

[0018] The communication network 106 may correspond to a communication medium through which the electronic device 102 and the database server 104 may communicate with each other. Such communication may be performed according to various wired and wireless communication protocols. Examples of such wired and wireless communication protocols include, but are not limited to, Transmission Control Protocol and Internet Protocol (TCP / IP), User Datagram Protocol (UDP), Hypertext Transfer Protocol (HTTP), File Transfer Protocol (FTP), ZigBee, EDGE, Infrared (IR), IEEE 802.11, 802.16, 2G, 3G, 4G, 5G, 6G cellular communication protocols, and / or Bluetooth (BT) communication protocols. Furthermore, the communication network 106 may include, but is not limited to, the Internet, a cloud network, a Wireless Fidelity (Wi-Fi) network, a Wireless Local Area Network (WLAN), a Local Area Network (LAN), a Power Over Telephone (POTS), and / or a Metropolitan Area Network (MAN).

[0019] 2 is a block diagram illustrating an electronic device 102 configured to provide multimodal content to a first user, which will be described in conjunction with elements from FIG. 1, where the electronic device 102 includes a processor 202, a memory 204, a transceiver 206, an input / output unit 208, and a multimodal content determination unit 210. The processor 202 is further preferably communicatively coupled to the memory 204, the transceiver 206, the input / output unit 208, and the multimodal content determination unit 210, and the transceiver 206 is preferably communicatively coupled to the communication network 106.

[0020] The processor 202 comprises suitable logic, circuits, interfaces, and / or code that may be configured to execute a set of instructions stored in the memory 204 and may be implemented based on several processor technologies known in the art. The processor 202 cooperates with the transceiver 206, the input / output unit 208, and the multimodal content determination unit 210 to provide multimodal content to the first user. Examples of the processor 202 include, but are not limited to, processors such as, for example, X86-based processors, Reduced Instruction Set Computing (RISC) processors, Application Specific Integrated Circuit (ASIC) processors, and Complex Instruction Set Computing (CISC) processors.

[0021] The memory 204 comprises suitable logic, circuitry, interfaces, and / or code that may be configured to store a set of instructions executed by the processor 202. Preferably, the memory 204 is configured to store one or more programs, routines, or scripts that execute in coordination with the processor 202. Furthermore, the memory 204 may be a Random-Access Memory (RAM), a Read-Only Memory (ROM), a Hard Disk Drive (HDD), a storage server, or a Secure Digital (SD) card.

[0022] The transceiver 206 comprises suitable logic, circuitry, interfaces, and / or code that may be configured to receive multimodal content provided to a first user over the communications network 106. The transceiver 206 is preferably configured to receive multimodal content recorded for multiple users, and is preferably further configured to receive demographic or psychographic information associated with the users, as well as preferences of the first user.

[0023] The transceiver 206 may implement one or more known technologies to support wired or wireless communication with the communication network 106. In one embodiment, the transceiver 206 may include, but is not limited to, an antenna, a radio frequency (RF) transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a universal serial bus (USB) device, a coder-decoder (CODEC) chipset, a subscriber identity module (SIM) card, and / or a local buffer. The transceiver 206 may also communicate via wireless communication with a network, for example, the Internet, an intranet, and / or a wireless network, such as a cellular network, a wireless local area network (LAN), and / or a metropolitan area network (MAN). Thus, wireless communication may use any of a number of communication standards, protocols, and technologies, such as: Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, and / or IEEE 802.11h), Voice over Internet Protocol (VoIP), Wi-MAX, Protocol for Mail, Instant Messaging, and / or Short Message Service (SMS).

[0024] The input / output unit 208 comprises appropriate logic, circuitry, interfaces, and / or code that may be configured to provide one or more inputs for providing multimodal content to the first user. The input / output unit 208 comprises various input and output devices configured to communicate with the processor 202. Examples of input devices include, but are not limited to, a keyboard, a mouse, a joystick, a touch screen, a microphone, a camera, and / or a docking station. Examples of output devices include, but are not limited to, a display screen and / or a speaker. Furthermore, the display screen is preferably configured to display multimedia content, including content created by the second user, to the first user, and the speaker plays audio content.

[0025] The multimodal content determination unit 208 comprises suitable logic, circuitry, interfaces, and / or code that may be configured to determine digital multimodal content to be provided to the first user based on at least one of the first user's demographic information and the first user's preferences related to real estate. The multimodal content determination unit 208 may be further configured to determine the first user's preferences related to real estate based on the multiple data sources using one or more machine learning techniques, and may be further configured to determine the first user's demographic information via the data sources or machine learning.

[0026] In an exemplary operation, a second user managing an application installed on electronic device 102 to provide multimodal content to a first user may upload a plurality of digital multimedia contents, such as images and videos, to database server 104. Preferably, each of the plurality of multimedia contents is associated with at least one tag (each tag may be used to retrieve the multimedia content from database server 104). For example, an image of a tiger may have associated tags such as "apartment," "duplex," and "single family home."

[0027] Further, the second user may record multimodal content for a plurality of users and associate each content with at least one demographic or psychographic information or preference (known, discovered, or predicted) of each of the plurality of users. In one embodiment, the demographic information for each of the plurality of users is determined from a plurality of sources and stored in a database server. For example, the second user may know the ethnicity and preferred language of the first user. Thus, the second user may record audio or video in the preferred language of the first user and may change the accent of the audio according to the intonation of the ethnicity of the first user. Preferably, each recorded multimodal content may be associated with one or more tags, and the tags of the multimedia content and the tags of the multimodal content may be compared to provide the most relevant multimodal content to the first user.

[0028] The first user can utilize a software application installed on the electronic device 102 to browse the multimodal content. The first user can provide a query to browse multimedia content, such as images or videos, associated with real estate or any other similar category. For example, the first user may type the query "showing real estate in Arlington, Texas." In response to the search query, the processor 202 can retrieve related multimedia content from the database server 104, and the display screen of the input / output unit 208 can display the multimedia content from the multiple users to the first user. For example, the processor 202 can search and retrieve all multimedia content with tags of "real estate," "Nashville," and "Tennessee" from the database server 104, and then display the retrieved multimedia content to the first user.

[0029] After displaying the multimedia content, the multimodal content determination unit 210 may be configured to receive the first user's demographic and / or psychographic information and preferences, such as real estate preferences, from the database server 104 via the transceiver 206. Furthermore, the multimodal content determination unit 210 may be configured to determine the first user's demographic / psychographic information and preferences using one or more machine learning techniques. For example, the demographic information may include details regarding the first user's age, race, ethnicity, gender, marital status, income, education, and employment. The psychographic information may include details such as, for example, safety or status. Examples of the first user's preferences may include "rental preferences", "detached villa preferences", "garden preferences", etc.

[0030] Further, the multimodal content determination unit 210 may be configured to determine the digital multimodal content to be provided to the first user based on the demographic and / or psychographic information, as well as the first user's preferences, such as real estate preferences. Following the above example, audio or video content associated with each of the multimedia content for display to the first user is identified. For example, the first user is shown an image of a property in Arlington, Texas. Along with the image, the first user is also shown a graphical user interface element. The multimodal content determination unit 210 may be configured to determine audio content related to the image shown to the first user, and the audio content may provide further information about the property in Arlington, Texas. The audio content may further include information about the property (e.g., "available for rent" or has garden space). Similarly, video content may be determined to show the first user images of the property's interior and exterior items.

[0031] After the multimodal content to be provided to the first user is determined, hyperlinks (internal or external) are associated with the graphical user interface elements shown to the user along with the multimedia content to enable the first user to navigate and view the multimodal content. While the first user is viewing the multimedia content, input from the first user may be received via the input / output unit 208 on the graphical user interface elements. The input may correspond to the first user performing one or more actions on the graphical user interface elements, such as hovering or clicking.

[0032] In response to the input from the user, the input / output unit 208 is configured to trigger playback of the determined multimodal content. For example, the first user views an image of a real estate in Arlington, Texas, and then clicks on a graphical user interface element. In response to the click, at least one digital multimodal content may be provided to the user. The first user may then listen to audio content and / or watch video content. In one embodiment, the multimodal content determination unit 210 may be configured to modify one or more characteristics associated with the audio content and video content based on the first user's demographic or psychographic information and / or the first user's preferences related to real estate. The one or more characteristics may include annotations, tone, subtitles, pitch, language, etc. After the first user views the multimodal content, the first user may provide feedback regarding the multimodal content.

[0033] Below are some examples of implementations of the present invention. Digital multimedia content displayed to the user: images Digital multimodal content provided to the user: Audio In an exemplary scenario, consider that User A is interested in Property A, and therefore, the user searches for Property A on the mobile app. In response, the mobile app may display an image of Property A. When the user clicks on a play icon, audio content associated with Property A may be played to User A. The audio content may be identified by the electronic device based on the user's demographic data. For example, the audio content may include additional information associated with Property A and one or more characteristics of the audio content, and may be modified based on User A's language and demographic data.

[0034] Digital multimedia content displayed to the user: images Digital multimodal content provided to users: Video In another embodiment, in response to User A clicking a play icon after viewing an image, User A may be presented with video content associated with Property A. For example, the video content may include one or more features of the video content, including additional information associated with Property A and annotations or subtitles, etc., that may be modified based on User A's language and demographic data. For example, the video content may show User A the interior and exterior environments of Property A.

[0035] Digital multimedia content presented to the user: Video Digital multimodal content provided to users: Video In an exemplary scenario, user B considers that he is interested in property B, and therefore, the user searches for property B on a mobile app installed on the electronic device. In response, the mobile app may display a video file of property B. Along with the video file, a play icon may be displayed to user B. When the user clicks the play icon, another video content associated with property B may be played to user B. The other video content may be identified by the electronic device based on the user's demographic data. For example, the other video content may include additional information associated with property B and one or more characteristics of the other video content based on user B's language and demographic data.

[0036] Digital multimedia content presented to the user: Video Digital multimodal content provided to the user: Audio In another example scenario, when User B clicks the play icon, audio content associated with property B may be played to User B. The audio content may be identified by the electronic device based on demographic data of User B. For example, the audio content may include additional information associated with property B and one or more characteristics of the audio content modified based on the language and demographic data of User B.

[0037] Those skilled in the art will appreciate that the scope of the present disclosure is not limited to displaying only one audio content or only one video content to a user in response to the user clicking a graphical user interface element, including that multiple audio and video files may be played for a user in response to the user clicking a graphical user interface element, and that a combination of audio and video files may be played for a user.

[0038] Those skilled in the art will understand that the scope of the present disclosure is not limited to providing multimodal content to a first user based on the aforementioned factors and using the aforementioned techniques, and the examples provided do not limit the scope of the present disclosure.

[0039] 3A and 3B show user interfaces 300 and 400 configured to display multimedia content (302a, 302b) and multimodal content to a first user. The multimedia content (302a, 302b) may be displayed to User A. Along with the multimedia content, a graphical user interface (301a, 301b) is also displayed to User A. After browsing the multimedia content (302a, 302b), User A may click on the graphical user interface (301a, 301b). In response to such an action, the electronic device 102 may be configured to provide multimodal content including at least one of audio content or video content to User A.

[0040] FIG. 4 illustrates a user interface 500 displayed to a second user for multimodal content recording. The second user may view the multimedia content 302c. Along with the multimedia content 302c, the second user may be presented with three user interface elements, such as a record button 401, a stop recording button 402, and a save record button 403. After viewing the multimedia content 302c, the second user may click the record button 401 to start recording the multimodal content associated with the multimedia content 302c. For example, the second user may click the record button 401 and then record audio content associated with the multimedia content 302c. Similarly, the second user may click the record button 401 and then record video content associated with the multimedia content 302c.

[0041] When recording is finished, the second user can stop the recording by clicking the stop recording button 402. Additionally, the second user can click the save recording button 403 so that the recorded multimodal content (audio and video content) is associated with the multimedia content 302c.

[0042] 5 is a flow chart illustrating a method 600 for providing multimodal content to a first user on an electronic device 102. The method begins at a start step 602 and proceeds to a display step 604.

[0043] In a display step 604, the electronic device 102 displays multimedia content from the plurality of users to a first user. Then, in a determination step 606, the electronic device 102 determines the multimodal content to be provided to the first user based on at least one of the first user's demographic information and the first user's preferences related to real estate. In an input receiving step 608, the electronic device 102 receives input from the first user on a graphical user interface element displayed with the multimedia content. In one embodiment, the input corresponds to the first user performing one or more actions on the graphical user interface element. Further, in a trigger play step 610, the electronic device 102 triggers playback of the determined multimodal content in response to the user performing one or more actions on the graphical user interface element, and control proceeds to a stop step 612.

[0044] FIG. 6 illustrates a block diagram of an exemplary computer system 601 for implementing embodiments consistent with this disclosure.

[0045] Variations of computer system 601 may be used to perform optical character recognition on an image containing multiple printed characters. Computer system 601 may include a central processing unit ("CPU" or "processor") 602. Processor 602 may include at least one data processor for executing program components for executing requests generated by a user or a system. A user may include a person, a person using an apparatus as included in this disclosure, or the apparatus itself. Additionally, processor 602 may include dedicated processing units such as an integrated system (bus) controller, a memory management control unit, a floating point unit, a graphics processing unit, a digital signal processing unit, and the like. In various implementations, processor 602 may include a microprocessor, such as, for example, an AMD Athlon, Duron or Opteron, ARM's application, embedded or secure processors, IBM PowerPC, Intel's Core, Itanium, Xeon, Celeron, or other lines of processors. Thus, processor 602 may be implemented using mainframe, distributed processor, multi-core, parallel, grid, or other architectures. Some embodiments may utilize embedded technologies such as, for example, application specific integrated circuits (ASICs), digital signal processors (DSPs), or field programmable gate arrays (FPGAs).

[0046] The processor 602 is arranged to communicate with one or more input / output (I / O) devices via an I / O interface 603. As such, the I / O interface 603 may use communication protocols / methods such as, but not limited to, audio, analog, digital, mono, RCA, stereo, IEEE-1394, serial bus, Universal Serial Bus (USB), infrared, PS / 2, BNC, coaxial, component, composite, Digital Visual Interface (DVI), High Definition Multimedia Interface (HDMI), RF antenna, S-Video, VGA, IEEE 802n / b / g / n / x, Bluetooth, cellular (e.g., Code Division Multiple Access (CDMA)), High Speed ​​Packet Access (HSPA+), Global System for Mobile Communications (GSM), Long Term Evolution (LTE), WiMax, etc.

[0047] Using the I / O interface 603, the computer system 601 can communicate with one or more I / O devices. For example, the input device 604 can be, for example, an antenna, a keyboard, a mouse, a joystick, an (infrared) remote control, a camera, a card reader, a fax machine, a dongle, a biometric reader, a microphone, a touch screen, a touch pad, a track ball, a sensor (e.g., an accelerometer, a light sensor, a GPS, a gyroscope, a proximity sensor, etc.), a stylus, a scanner, a storage device, a transceiver, a video device / source, or a visor. Similarly, the output device 605 can be, for example, a printer, a fax machine, a video display (e.g., a cathode ray tube (CRT), a liquid crystal display (LCD), a light emitting diode (LED), a plasma, etc.), or an audio speaker. In some embodiments, the transceiver 606 can be disposed in association with the processor 602. The transceiver 606 can facilitate various types of wireless transmission or reception. For example, the transceiver 606 may include an antenna operatively connected to a transceiver chip (exemplary devices include the Texas Instruments® WiLink WL1283, Broadcom® BCM4750IUB8, Infineon Technologies® X-Gold 618-PMB9800, etc.) that provides, for example, IEEE 802.11a / b / g / n, Bluetooth®, FM, Global Positioning System (GPS), and / or 2G / 3G / 5G HSDPA / HSUPA communications.

[0048] In some embodiments, the processor 602 may be arranged to communicate with a communication network 608 via a network interface 607. The network interface 607 is adapted to communicate with the communication network 608. The network interface 607 may employ a connection protocol including, but not limited to, direct connect, Ethernet (e.g., twisted pair 10 / 100 / 1000 base-T), Transmission Control Protocol / Internet Protocol (TCP / IP), Token Ring, or IEEE 802.11a / b / g / n / x. The communication network 608 may include, but is not limited to, a direct interconnect, a local area network (LAN), a wide area network (WAN), a wireless network (e.g., using a wireless application protocol), or the Internet. Using the network interface 607 and the communication network 608, the computer system 601 may communicate with devices such as a mobile / cell phone 610, a point of sale terminal 611, or a laptop 609 as shown. Other exemplary devices may include, but are not limited to, personal computers, servers, fax machines, printers, scanners, various mobile devices such as cell phones, smartphones (e.g., Apple iPhone®, Blackberry, Android-based phones, etc.), tablet computers, eBook readers (Amazon Kindle, Nook, etc.), laptop computers, notebooks, game consoles (Microsoft Xbox, Nintendo DS, Sony PlayStation, etc.), etc. In some embodiments, computer system 601 may itself embody one or more of these devices.

[0049] In some embodiments, the processor 602 may be arranged to communicate with one or more memory devices (e.g., RAM 613, ROM 614, etc.) via a storage interface 612. The storage interface 612 may connect to memory devices including, but not limited to, memory drives, removable disk drives, etc. using connection protocols such as Serial Advanced Technology Attachment (SATA), Integrated Drive Electronics (IDE), IEEE-1394, Universal Serial Bus (USB), Fibre Channel, Small Computer System Interface (SCSI), etc. The memory drives may further include, for example, drum, magnetic disk drives, magneto-optical drives, optical drives, redundant array of independent discs (RAID), solid state memory devices, or solid state drives.

[0050] The memory device may store a collection of programs or database components including, for example, but not limited to, an operating system 616, a user interface application 617, a web browser 618, a mail server 619, a mail client 620, and user / application data 621 (e.g., any data variables or data records discussed in this disclosure). The operating system 616 can facilitate resource management and operation of the computer system 601. Examples of operating systems include, but are not limited to, Apple Macintosh OS X, UNIX, UNIX-like system distributions (e.g., Berkeley Software Distribution (BSD), FreeBSD, NetBSD, OpenBSD, etc.), Linux distributions (e.g., Red Hat, Ubuntu, Kubuntu, etc.), IBM OS / 2, Microsoft Windows (XP, Vista / 7 / 8, etc.), Apple iOS, Google Android, Blackberry OS, etc.

[0051] The user interface 617 is for facilitating the display, execution, interaction, manipulation, or operation of program components through textual or graphical facilities. For example, the user interface may provide computer interaction interface elements on a display system operatively connected to the computer system 601, such as, for example, cursors, icons, checkboxes, menus, scrollers, windows, or widgets. For example, graphical user interfaces (GUIs) may be employed, including, but not limited to, Apple Macintosh operating system Aqua, IBM OS / 2, Microsoft Windows (e.g., Aero, Metro, etc.), Unix X-Windows, or web interface libraries (e.g., ActiveX, Java, Javascript, AJAX, HTML, Adobe Flash, etc.).

[0052] In some embodiments, computer system 601 may implement program components stored in a web browser 618. Web browser 618 may be a hypertext browsing application such as, for example, Microsoft Internet Explorer, Google Chrome, Mozilla Firefox, Apple Safari, or Microsoft Edge. Secure web browsing may be provided using secure hypertext transport protocol (HTTPS), secure sockets layer (SSL), Transport Layer Security (TLS), or the like. The web browser may utilize facilities such as, for example, AJAX, DHTML, Adobe Flash, JavaScript, Java, or application programming interfaces (APIs). In some embodiments, computer system 601 may implement program components stored in a mail server 619. Mail server 619 may be an Internet mail server such as Microsoft Exchange. The mail server may utilize facilities such as, for example, ASP, ActiveX, ANSIC++ / C#, Microsoft.NET, CGI script, Java, JavaScript, PERL, PHP, Python, or WebObject. The mail server 619 may utilize a communication protocol such as internet message access protocol (IMAP), messaging application programming interface (MAPI), Microsoft Exchange, post office protocol (POP), simple mail transfer protocol (SMTP), etc. In some embodiments, the computer system 601 may implement program components stored in a mail client 620.The mail client 620 may be a mail viewing application such as Apple Mail, Microsoft Entourage, Microsoft Outlook, or Mozilla Thunderbird.

[0053] In some embodiments, computer system 601 may store user / application data 621, such as data, variables, records, etc., as described in this disclosure. Such databases may be implemented as fault-tolerant, relational, scalable, secure databases, such as, for example, Oracle or Sybase. Alternatively, such databases may be implemented using standardized data structures, such as arrays, hashes, linked lists, structures, structured text files (e.g., XML), tables, or as object-oriented databases (e.g., using ObjectStore, Poet, Zope, etc.). Such databases may be integrated or distributed among the various computer systems described above in this disclosure. It should be understood that the structure and operation of any computer or database component may be combined, integrated, or distributed in any working combination.

[0054] Furthermore, one or more computer-readable storage media may be utilized in implementing embodiments consistent with the present invention. A computer-readable storage medium refers to any type of physical memory in which information or data readable by a processor may be stored. Thus, a computer-readable storage medium may store instructions for execution by one or more processors, including instructions for causing the processor to execute steps or stages consistent with the embodiments described herein. The term "computer-readable medium" should be understood to include tangible items and exclude carrier waves and transient signals, i.e., non-transient. Examples include Random-Access Memory (RAM), Read-Only Memory (ROM), volatile memory, non-volatile memory, hard drives, compact discs (CD) ROMs, digital video discs (DVDs), flash drives, disks, and any other known physical storage medium.

[0055] Various embodiments of the present disclosure encompass numerous advantages including methods and systems for providing multimodal content to a first user. In an embodiment, the methods and systems may enable a user to associate a video file with an image file that the user can view when the user clicks on the image. Additionally, the disclosed methods and systems provide a means for the user to view additional multimodal content (audio or video) that is associated with multimedia content such as an image or video file. Additionally, the multimodal content viewed by the user is determined based on the user's preferences and / or the user's demographic information, thus providing the user with a more personalized experience.

[0056] The present disclosure may be realized in hardware or in a combination of hardware and software. The present disclosure may be realized in a centralized manner in at least one computer system, or in a distributed manner, with different elements being distributed across several interconnected computer systems. Any computer system or other device adapted to perform the methods described herein may be suitable. The combination of hardware and software may be a general-purpose computer system with a computer program that, when loaded and executed, may control the computer system to perform the methods described herein. The present disclosure may be realized in hardware, including parts of an integrated circuit that also perform other functions.

[0057] Those skilled in the art will appreciate that the systems, modules, and sub-modules have been shown and described to serve as examples and should not be considered limiting in any manner. Moreover, it will be appreciated that variations or alternatives of the above-disclosed system elements, modules, and other features and functions can be combined to create other different systems or applications.

[0058] Those skilled in the art will appreciate that any of the above steps and / or system modules may be appropriately substituted, reordered, or removed, and additional steps and / or system modules may be inserted, as needed for a particular application. Furthermore, the systems of the above-described embodiments may be implemented using a wide variety of suitable processes and system modules, and are not limited to any particular computer hardware, software, middleware, firmware, microcode, etc. The claims may encompass embodiments for hardware and software, or combinations thereof.

[0059] Although the present disclosure has been described with reference to specific embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted without departing from the scope of the present disclosure. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the present disclosure without departing from its scope. Therefore, it is not intended that the present disclosure be limited to the particular embodiments disclosed, but rather that the present disclosure will include all embodiments falling within the scope of the appended claims.

Claims

1. 1. A method for presenting additional digital content to a first user that is associated with administratively recorded digital content for a real estate property, the method comprising: defining a first user type as a user of the real estate software application that does not have administrative access to the real estate software application by an electronic device executing said software application; defining, by the electronic device, a second user type as a user of a real estate software application having administrative access to the real estate software application; defining, by said electronic device, a managed digital content type including only managed digital content as digital content created by users belonging to said second user type; defining, by said electronic device, a multimodal digital content type including only multimodal digital content as digital content associated with managed digital content; receiving, by the electronic device via the real estate software application, first managed digital content associated with a first real estate property; receiving, by the electronic device via the real estate software application, first multimodal digital content associated with the first managed digital content; displaying, by an electronic device executing the software application, the first managed digital content to a first user; displaying, by the electronic device, a first graphical user interface element associated with the first multimodal digital content along with the first managed content; the first multimodal digital content includes audio; receiving, by the electronic device, an input associated with the graphical user interface element displayed with the managed content, the input corresponding to a request by the user to play the first multimodal content; triggering, by the electronic device, presentation of the first multimodal digital content in response to the user input; recording, by the electronic device, a second multimodal digital content associated with demographic information, psychographic information, or preferences of the first user of the software application; associating, by the electronic device, the first multimodal digital content with a first psychological information type; associating, by the electronic device, the second multimodal digital content with a second psychological information type; associating, by the electronic device, a first user of the software application with a user psychographic type; and determining, by the electronic device, whether to provide the first or second multimodal digital content to the first user based on the psychographic information type of the user; A method comprising:

2. 10. The method of claim 1, further comprising associating the first digital multimodal content with first demographic information.

3. 10. The method of claim 1, wherein the second multimodal digital content includes a user's opinion of the first managed digital content.

4. 10. The method of claim 1, wherein the first multimodal content includes a first audio content.

5. 2. The method of claim 1, wherein the first managed digital content is an image file.

6. 1. An electronic device for providing digital multimodal content to a first user, the electronic device comprising: A hardware processor; and a memory communicatively coupled to the hardware processor storing processor instructions as software that, when executed, cause the hardware processor to perform: defining a first user type as a user of the real estate software application that does not have administrative access to the real estate software application; defining a second user type as a user of the real estate software application having administrative access to the real estate software application; defining a managed digital content type including only managed digital content as digital content created by users belonging to said second user type; defining a multimodal digital content type that includes only multimodal digital content as digital content that is related to managed digital content; receiving, via the real estate software application, first managed digital content associated with a first real estate property; receiving, via the real estate software application, first multimodal digital content associated with the first managed digital content; displaying, by an electronic device executing the software application, a first managed digital content to a first user; displaying a first graphical user interface element associated with the first multimodal digital content along with the first managed content; the first multimodal digital content includes audio; receiving, by the electronic device, an input associated with the graphical user interface element displayed with the managed content, the input corresponding to a request by the user to play the first multimodal content; triggering, by the electronic device, presentation of the first multimodal digital content in response to the user input; recording a second multimodal digital content associated with demographic information, psychographic information, or preferences of a first user of the software application; Associating the first multimodal digital content with a first psychological information type; Associating the second multimodal digital content with a second psychological information type; Associating a first user of the software application with a user psychographic information type; and determining whether to provide the first or second multimodal digital content to the first user based on a psychological information type of the user; An electronic device comprising:

7. The electronic device of claim 6 , wherein the first multimodal content includes at least video content.

8. 7. The electronic device of claim 6, wherein the first managed digital content is an image file.

9. When processed by at least one hardware processor, the electronic device: defining a first user type as a user of the real estate software application that does not have administrative access to the real estate software application; defining a second user type as a user of the real estate software application having administrative access to the real estate software application; defining a managed digital content type including only managed digital content as digital content created by users belonging to said second user type; defining a multimodal digital content type including only multimodal digital content as digital content related to the managed digital content; receiving, via the real estate software application, first managed digital content associated with a first real estate property; receiving, via the real estate software application, first multimodal digital content associated with the first managed digital content; displaying, by an electronic device executing the software application, the first managed digital content to a first user; displaying a first graphical user interface element associated with the first multimodal digital content along with the first managed content; the first multimodal digital content includes audio; receiving, by the electronic device, an input associated with the graphical user interface element displayed with the managed content, the input corresponding to a request by the user to play the first multimodal content; triggering, by the electronic device, presentation of the first multimodal digital content in response to the user input; recording a second multimodal digital content associated with demographic information, psychographic information, or preferences of a first user of the software application; associating the first multimodal digital content with a first psychological information type; associating the second multimodal digital content with a second psychological information type; associating a first user of the software application with a user psychographic type; and determining whether to provide the first or second multimodal digital content to the first user based on a psychological information type of the user; A non-transitory computer-readable medium having stored thereon instructions for performing operations including:

Citation Information

Patent Citations

  • System and method for providing recommendation on electronic device on the basis of affective state detection

    JP2018041460A

  • Program executed by computer capable of communicating with head mounted device, information processing apparatus for executing that program, and method implemented by computer capable of communicating with head mounted device

    JP2018200566A

  • Methods and systems for online video-based property commerce

    US20070294622A1

  • System and Method for Searching Real Estate Listings Using Imagery

    US20120089597A1