System and method for providing information related to published contents

Abstract

To provide a system capable of providing a user reading a printed matter or publication with information related to published contents printed on a paper surface thereof in the form of voice in a timely manner.SOLUTION: A system for providing information related to published contents comprises: an information processing terminal 1 that is used by a user; and a server 2 that stores data for outputting information related to the published contents on a paper surface by voice. The information processing terminal 1 includes: a reading unit 101 that reads a code printed on the paper surface at a part in close proximity to the published contents; a request transmitting unit 102 that requests transmission of data from the server 2 indicated by a URL recorded in the read code; a data receiving unit 103 that receives the data transmitted from the server 2; and an output unit 104 that outputs the information related to the published contents on the paper surface by voice based on the received data. The server 2 includes: a request receiving unit 202 that receives a request coming from the information processing terminal 1; and a data transmitting unit 203 that transmits the data corresponding to the received request to the information processing terminal 1.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to a system and method capable of providing information related to the contents published on the pages of a printed matter or publication to a user reading the printed matter or publication in a timely manner. [Background technology]

[0002] Today, many people use portable information processing devices such as smartphones and tablets to access the Internet and obtain various information via wireless communication connections such as mobile phone networks, Wimax (registered trademark) networks, and public wireless LANs (Local Area Networks).

[0003] When acquiring various information from a server using a web browser installed on an information processing terminal, it is necessary to input a URL (Uniform Resource Locator) that points to a desired website or web page. Recently, it has become possible to easily access a website or web page with a URL recorded in a two-dimensional code, such as a QR Code (registered trademark), by reading the two-dimensional code with a camera (image sensor) of an information processing terminal (see, for example, the prior art document below). [Prior art documents] [Non-patent literature]

[0004] [Non-Patent Document 1] “What is QR Code(R)? | QR Code Related Knowledge | Basic Knowledge | QR Solutions | DENSO WAVE”, [online], DENSO WAVE Inc., [searched on September 30, 2023], Internet<URL:https: / / www.denso-wave.com / ja / system / qr / fundamental / qrcode / qrc / index.html> Summary of the Invention [Problem to be solved by the invention]

[0005] The publishing industry has been in a slump for some time now. Magazines in particular are struggling in the market.

[0006] Printed matter and publications attempt to convey information to readers through words, pictures, diagrams, charts, and photographs, but it is not possible to deliver audio to readers. For children, young boys and girls, or the elderly, there is a concern that they will not be able to fully enjoy the information or fully grasp the content just by reading the page. If audio that conveys information related to the content can be simultaneously provided to readers along with the content published on the page (for example, if it can be read aloud), readers will be able to understand the content published on the page more deeply and will become more interested in and curious about the content. Ultimately, this will increase the utility and added value of the printed matter or publication.

[0007] In consideration of the above, the present invention aims to realize a system and method that can provide a user reading a printed matter or publication with timely information in the form of audio regarding the contents printed on the page. [Means for solving the problem]

[0008] In the present invention, a system for providing information related to published content is configured, whose elements are an information processing terminal used by a user who reads the published content printed on the page of a printed matter or publication, and a server storing data for outputting information related to the published content of the printed matter or publication by voice, wherein the information processing terminal is equipped with a reading unit that reads a code printed in close proximity to the published content on the page of the printed matter or publication, a request sending unit that requests a server indicated by a URL recorded in the code read by the reading unit to send data for outputting information related to the published content of the printed matter or publication by voice, a data receiving unit that receives the data sent from the server in response to a request by the request sending unit, and an output unit that outputs information related to the published content of the printed matter or publication by voice based on the data received by the data receiving unit, and the server is equipped with a request receiving unit that receives a request from the information processing terminal, and a data sending unit that sends the data corresponding to the request received by the request receiving unit to the information processing terminal.

[0009] Here, the "server" referred to in the present invention may be embodied by a single server computer, or by a set of multiple server computers (including so-called clusters and clouds). "Data for outputting information related to the contents of printed matter or publications" may be a set of multiple data files. In such a case, the set of data files is stored in a "server" and provided from the server to an information processing terminal, but the server computer providing one data file may be different from the server computer providing another data file.

[0010] The printed matter or publication may have areas in which multiple contents are printed within a single sheet, a single page, or the left and right pages of a spread, and a code recording a different URL may be printed for each of these areas.Then, a data transmission unit of the server may transmit the different data to the information processing terminal used by the user according to the code read by the information processing terminal, and an output unit of the information processing terminal may output by voice different information for each area in which the contents are printed in the printed matter or publication, based on the data received by the receiving unit.

[0011] If the server also stores data for outputting information related to the contents of the printed matter or publication as one or more images, and a request sending unit of the information processing terminal requests the server indicated by the URL recorded in the code read by the reading unit to send data for outputting the information related to the contents of the printed matter or publication as voice and one or more images, and a data sending unit of the server sends the data corresponding to the request received by the request receiving unit to the information processing terminal, and an output unit of the information processing terminal outputs the information related to the contents of the printed matter or publication as voice and one or more images based on the data received by the data receiving unit, it becomes possible to provide information related to the contents of the printed matter or publication to the user in a timely manner in the form of images in addition to voice.

[0012] In the present invention, the "image" is primarily intended to mean a still image, but it may also be something like an animated GIF (Graphics Interchange Format) or a moving image with a relatively small amount of data and a short playback time.

[0013] Furthermore, if the data transmitted by the data transmitting unit of the server and received by the data receiving unit of the information processing terminal includes URL information corresponding to each image output by the output unit of the information processing terminal, the information processing terminal has an input receiving unit that receives an operation by a user to select one or more images output by the output unit, and the request transmitting unit of the information processing terminal requests the transmission of data to output some information from a server pointed to by a URL corresponding to the image selected by the operation received by the input receiving unit, then it is possible to induce access to a server that provides information accompanying the content published in a printed matter or publication, additional information, advanced information, etc.

[0014] One example of something that can be used to realize the published content related information provision system of the present invention is a combination of a printed matter or publication on whose page the published content to be read by a user is printed and on which a code recording a URL is printed in a location on the same page close to the published content, and a server equipped with a request receiving unit that receives a request for transmission of data for outputting information related to the published content of the printed matter or publication by voice, which request is made from an information processing terminal used by the user by reading the code printed on the printed matter or publication, and a data transmitting unit that transmits the data corresponding to the request received by the request receiving unit to the information processing terminal.

[0015] The method for providing information related to published contents of the present invention includes the steps of: an information processing terminal used by a user reading the published contents printed on the page of a printed matter or publication reads a code printed in a location close to the published contents on the page of the printed matter or publication; the information processing terminal requests a server indicated by a URL recorded in the read code to transmit data for outputting information related to the published contents of the printed matter or publication by voice; the server receives the request from the information processing terminal; the server transmits the data corresponding to the request received by the request receiving unit to the information processing terminal; the information processing terminal receives the data transmitted from the server in response to the request; and the information processing terminal outputs information related to the published contents of the printed matter or publication by voice based on the received data. Effect of the Invention

[0016] According to the present invention, a system and method are realized that can provide a user reading a printed matter or publication with information related to the contents printed on the page in audio format at the appropriate time. [Brief description of the drawings]

[0017] [Figure 1] 1 is a diagram showing the overall configuration of a publication content related information providing system according to an embodiment of the present invention; [Diagram 2] 2 is a diagram showing hardware resources of an information processing terminal used by a user in the system of the embodiment. [Diagram 3] FIG. 2 is a diagram showing hardware resources of a server in the system of the embodiment. [Figure 4] FIG. 2 is a functional block diagram of the system according to the embodiment. [Diagram 5] FIG. 4 is a flowchart showing an example of a procedure of a process executed by the system of the embodiment. [Figure 6]11 is a diagram showing an example of an HTML file that is part of data for outputting information related to the contents of a printed matter or publication, the data being transmitted from the server to the information processing terminal in the system of the embodiment. FIG. [Figure 7] 11 is a diagram showing an example of an HTML file that is part of data for outputting information related to the contents of a printed matter or publication, the data being transmitted from the server to the information processing terminal in the system of the embodiment. FIG. [Figure 8] 3 is a diagram showing examples of printed matter or publications that a user can read in the system of the embodiment. [Figure 9] 7 is a diagram showing an example of information output from an information processing terminal as a result of a user reading the code on the surface of the printed matter or publication shown in FIG. 6 using the information processing terminal. [Figure 10] 7 is a diagram showing an example of information output from an information processing terminal as a result of a user reading the code on the surface of the printed matter or publication shown in FIG. 6 using the information processing terminal. [Figure 11] 9 is a diagram showing an example of information output from the information processing terminal as a result of a user's operation of selecting one of the images shown in FIG. 8 using the information processing terminal. [Figure 12] 3 is a diagram showing examples of printed matter or publications that a user can read in the system of the embodiment. [Figure 13] 13 is a diagram showing an example of information output from an information processing terminal as a result of a user reading the code on the surface of the printed matter or publication shown in FIG. 12 using the information processing terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] An embodiment of the present invention will be described with reference to the drawings. The system for providing information related to published contents of the present embodiment provides information related to the contents of the printed matter or publication P1, P2 to a user reading the printed matter or publication P1, P2 in the form of audio and images in a timely manner.

[0019] As shown in FIG. 1, this system is configured by connecting an information processing terminal 1 used by a user who reads printed matter or publications P1, P2, and a server 2 that stores data for outputting information on the contents of the printed matter or publications P1, P2 via the information processing terminal 1 used by the user, so that they can communicate with each other via an electric communication line 3. The server 2 may be realized by a single server computer, or may be realized by a set of multiple server computers (including a so-called cluster or cloud). Specific examples of the electric communication line 3 include public networks such as the Internet, public telephone networks, mobile phone networks, WiMAX networks, public wireless LANs, and other mobile wireless communication networks. However, the entire communication path connecting the information processing terminal 1 and the server 2 is not necessarily a public network. For example, each of the computers 1, 2 may be directly connected to a private wireless LAN or wired LAN, and may be indirectly connected to a public network such as the Internet via the LAN.

[0020] The information processing terminal 1 used by a user is, for example, a mobile phone terminal represented by a smartphone, a tablet, a personal computer (laptop (notebook) type computer), a portable video game machine, etc. As shown in Fig. 2, the information processing terminal 1 includes hardware resources such as a CPU (Central Processing Unit) 1a, a main memory 1b, an auxiliary storage device 1c, an operation input device 1d, an audio codec 1e, a video codec 1f, a communication interface 1g, a speaker 1h, a display 1i, a microphone 1j, and a camera (image sensor) 1k, which are controlled by a controller (system controller, I / O controller, etc.) 1l to operate in cooperation with each other.

[0021] The auxiliary storage device 1c is a flash memory, a hard disk drive, an optical disk drive, or the like. The operation input device 1d is a touch panel, a track pad, a pointing device such as a mouse, which can be operated by fingers, a push button, a keyboard, or the like. The touch panel 1d may be provided over the screen of the display 1i. The audio codec 1e encodes the sound input through the microphone 1j, while decoding the encoded sound data and outputting the sound from the speaker 1h. The video codec 1f includes a GPU (Graphics Processing Unit) that generates a screen to be displayed based on a drawing instruction received from the CPU 1a and sends the screen signal to the display 1i, a video memory that temporarily stores screen and image data, and other elements. The audio codec 1e and the video codec 1f can also be implemented as software instead of hardware.

[0022] The communication interface 1g is a device for transmitting and receiving data to and from the server 2 via the electric communication line 3, and is a wireless device for a mobile wireless communication network, a Wi-Fi (registered trademark) device for wireless LAN, a Bluetooth (registered trademark) transceiver for short-distance communication, a NIC (Network Interface Card) for Ethernet (registered trademark), etc. In addition to these, an interface such as a USB (Universal Serial Bus) may also be implemented.

[0023] The program to be executed by the CPU 1a is stored in the auxiliary storage device 1c, and when the program is executed, it is read from the auxiliary storage device 1c to the main memory 1b and decoded by the CPU 1a. In this embodiment, a known OS (Operating System) program and various device driver programs associated therewith are pre-installed and mediate the use of hardware resources by other programs. In addition, application programs such as a known web browser are installed in the information processing terminal 1.

[0024] The information processing terminal 1 operates the above hardware resources in accordance with a program, and exerts the functions of a reading unit 101, a request transmitting unit 102, a data receiving unit 103, an output unit 104, and an input accepting unit 105 shown in FIG.

[0025] The reading unit 101 reads a code printed on the surface of a printed matter or publication P1, P2 that a user is reading. The code is a one-dimensional code such as a barcode, or a two-dimensional code such as a QR code. The reading unit 101 receives light reflected from a portion of the paper containing the code using a CCD (Charge Coupled Device), CMOS (Complementary Metal-Oxide-Semiconductor), or other light receiving element, and performs a decoding process to determine the code system and extract the numerical value and / or character string recorded in the code. In this embodiment, the reading unit 101 is configured using a camera 1k.

[0026] The request sending unit 102 requests the server 2 indicated by the URL recorded in the code read by the reading unit 101 to transmit data for outputting information related to the contents of the printed matter or publications P1, P2 in the form of audio and images. The request sending unit 102 transmits a request conforming to the communication protocol specified by the URL, for example, HTTP (HyperText Transfer Protocol), to the server 2 indicated by the URL via the electric communication line 3.

[0027] The data receiving unit 103 receives data transmitted from the server 2 in response to a request made by the request transmitting unit 102. The data is returned from the server 2 via the electric communication line 3 as a response to the request in accordance with a communication protocol.

[0028] The output unit 104 outputs information related to the contents of the printed matter or publications P1, P2 in the form of audio and images based on the data received by the data receiving unit 103. In this embodiment, the data for outputting information related to the contents of the printed matter or publications P1, P2 includes an HTML (HyperText Markup Language, which may be XHTML (Extensible HTML)) file, an audio file, and one or more image files. The image file is in principle a still image file of a predetermined format, but may be an animated GIF file or a moving image file as long as the data volume is relatively small and the playback time is short. It is also possible to have an audio file and an image file integrated together, that is, a moving image file of a predetermined format in reality, in which the moving image file includes an audio track.

[0029] An HTML file may contain a script written in CSS (Cascading Style Sheets) or JavaScript (registered trademark). Alternatively, the CSS or script may be an external file separate from the HTML file. The web browser of the information processing terminal 1 transmits a request to the server 2 indicated by the URL recorded in the code, receives the HTML file from the server 2, and interprets the contents of the HTML file. In addition, the web browser acquires the URL of an external file, such as an audio file or an image file, described in the HTML file, transmits a request to the server 2 indicated by the URL, and receives the necessary external file. Note that each file may be stored in a single computer 2 and provided to the information processing terminal 1 from the server computer 2, or may be stored separately in different server computers 2 and provided to the information processing terminal 1 individually from the server computers 2. In the latter environment, the information processing terminal 1 transmits a request to the server computers 2 by referring to the URL for each file, and receives each file from each server computer 2. Then, the web page composed of each file is rendered, audio is output from the speaker 1h, and images are displayed on the screen of the display 1i.

[0030] The input receiving unit 105, as a function of the output unit 104, receives an operation of the user manually selecting an image via the operation input device 1d when an image is displayed and output on the screen of the display 1i. Typically, the input receiving unit 105 receives an operation of the user tapping or clicking on an image via the pointing device 1d. In the HTML file or script previously received by the information processing terminal 1, a URL indicating new data to be requested next when an image is selected while the image is being displayed on the display 1i, or a URL of a destination (link destination) of a web page to be transitioned to is described. When an image is selected by the user, the request transmitting unit 102 transmits a new request via the telecommunication line 3 to the server 2 indicated by the URL corresponding to the image. Then, the receiving unit 103 receives the data returned from the server 2, and the output unit 104 outputs new information or a web page in the form of characters, voice and / or images based on the received data.

[0031] As shown in FIG. 3, the computer constituting the server 2 includes hardware resources such as a CPU 2a, a main memory 2b, an auxiliary storage device 2c, and a communication interface 2d, which are controlled by a controller 2e to operate in cooperation with one another.

[0032] The programs to be executed by the CPU 2a are stored in the auxiliary storage device 2c, and when the programs are executed, they are read from the auxiliary storage device 2c into the main memory 2b and decoded by the CPU 2a. In this embodiment, a known OS program and various associated device driver programs are pre-installed and mediate the use of hardware resources by other programs. In addition, a known web server program, etc. are installed in the server 2.

[0033] The server 2 operates the above hardware resources in accordance with a program, and performs the functions of a data storage unit 201, a request receiving unit 202, and a data transmitting unit 203 shown in FIG.

[0034] The data storage unit 201 utilizes the required memory area of ​​the main memory 2b or the auxiliary memory device 2c to store a group of data files necessary for outputting information relating to the contents of the printed matter or publications P1, P2 in the form of audio and images on the information processing terminal 1.

[0035] The request receiving unit 202 receives a request from the information processing terminal 1 via the electric communication line 3 in accordance with a predetermined communication protocol.

[0036] Data transmitting unit 203 transmits data corresponding to the request received by request receiving unit 202 to information processing terminal 1 which has made the request. The request received from information processing terminal 1 includes a URL that specifies a data file required by information processing terminal 1. Server 2 reads out the data file corresponding to the URL from data storage unit 201, and returns this to information processing terminal 1 via electric communication line 3 as a response to the request in accordance with the communication protocol.

[0037] 5 shows an example of the procedure of the process executed by the information processing terminal 1 and the server 2 in this system. A user reading the printed matter or publication P1, P2 uses the information processing terminal 1 to read the code printed on the surface of the printed matter or publication P1, P2 with the camera 1k at any time (step S11). The information processing terminal 1, having read the code, refers to the URL recorded in the code and requests the server 2 to transmit an HTML file (step S12). The server 2, having received the request from the information processing terminal 1 (step S21), returns the HTML file specified by the URL included in the request to the information processing terminal 1 (step S22), and the information processing terminal receives it (step S13).

[0038] Upon receiving the HTML file, information processing terminal 1 interprets the contents of the HTML file, references the URL contained therein, and requests server 2 to transmit the necessary audio files, image files, etc. (steps S14, S16). Having received the request from information processing terminal 1 (steps S23, S25), server 2 returns the audio files, image files, etc. specified by the URL contained in the request to information processing terminal 1 (steps S24, S26), which are then received by the information processing terminal (steps S15, S17).

[0039] The information processing terminal 1, which has acquired the necessary file from the server 2, renders a web page corresponding to the code read by the user, and outputs audio related to the contents of the printed matter or publication P1, P2 that the user is reading from the speaker 1h (step S18), and also displays an image related to the contents on the screen of the display 1i (step S19).

[0040] 6 and 7 show an example of an HTML file that the information processing terminal 1 that reads the code receives from the server 2 indicated by the URL recorded in the code. This HTML file is part of the data for outputting information related to the contents of the printed matter or publications P1 and P2 in audio and image form. CSS and JavaScript are written in the HTML file shown in the example. Symbol C1 in FIG. 6 indicates the location where the URL for receiving an image file from the server 2 is written. Specifically, the part "imageUrl: 'https: / / kyotomedialine.com / wp-content / uploads / 2024 / 10 / a001.jpeg'" serves to request the specific server 2 to send the image file "a001.jpeg". The following requests the transmission of four image files, "a002.jpeg", "a003.jpeg", and "a004.jpeg". According to the HTML file shown in the figure, the information processing terminal 1 receives four images from the server 2 and displays them one by one on the screen of the display 1i. The images displayed on the display 1i are switched every time a predetermined time elapses. In the example shown in the figure, the images are set to be switched every ten seconds.

[0041] Furthermore, the portion "linkUrl: 'https: / / AEshop.co.jp / shop / a001.html'" is a URL indicating the server 2 to which the next request should be sent and the new data to be requested when the user taps or clicks on the image "a001.jpeg" displayed on the display 1i and selects the image. At this time, the information processing terminal 1 executes a process to access "https: / / AEshop.co.jp / shop / a001.html". When the image "a002.jpeg" is displayed on the display 1i and the user taps or clicks on the image, "https: / / AEshop.co.jp / shop / a002.html" will be accessed.

[0042] 7 indicates a portion in which a URL for receiving an audio file from the server 2 is written. Specifically, the portion "src="http: / / kyotomedialine.com / wpcontent / uploads / 2024 / 10 / a001-a004.mp3" autoplay controls playsinline" serves to request the specific server 2 to transmit the audio file "a001-a004.mp3." The information processing terminal 1 automatically plays back and outputs the audio file received from the server 2.

[0043] An example of a service realized by the present system and method is shown. FIG. 8 shows a magazine P1 as an example of a printed matter or publication read by a user. A single sheet or a single page of the magazine P1, and the left and right pages of a spread, have a plurality of areas, and each area carries individual contents. The contents of each area are characters, pictures, figures, tables, photographs, or combinations thereof, and are printed on the page to convey some information to the user who reads it. In addition, individual codes Q1, Q2, Q3, and Q4 are printed for each area in the vicinity of the contents of each area. The codes Q1, Q2, Q3, and Q4 corresponding to each area record different URLs.

[0044] A user reading the magazine P1 has the information processing terminal 1 read any one of the codes Q1, Q2, Q3, and Q4 attached to each area. The information processing terminal 1 then transmits a request to the server 2 specified by the URL recorded in the read code Q1, Q2, Q3, or Q4, and the server 2, upon receiving the request, transmits data for outputting audio and images on the information processing terminal 1 to the information processing terminal 1, in this embodiment, an HTML file, an audio file, an image file, and the like. The information processing terminal 1 receives each data file, and outputs audio and images related to the published contents of the area corresponding to the read code Q1, Q2, Q3, or Q4. The contents of the data received by the information processing terminal 1, i.e., the contents of the audio and images output by the information processing terminal 1, may differ depending on the code Q1, Q2, Q3, or Q4 read by the information processing terminal 1.

[0045] 9 shows an example in which the information processing terminal 1 reads the code Q1 on the page and outputs the voice V1 and image D1 information provided by the server 2, which corresponds to the content of the publication that corresponds to the code Q1 on the page. In this way, according to the present system and method, it is possible to provide the user with the information V1 and D1 related to the content printed on the page of the printed matter or publication P1 in the form of voice and image at the appropriate time.

[0046] Fig. 10 shows an example of outputting information on voices V21, V22 and images D21, D22 provided by the server 2 as a result of the information processing terminal 1 reading the code Q2 on the page, which corresponds to the published content corresponding to the code Q2 on the page. Fig. 10 shows a pattern in which the information processing terminal 1 receives a data file of a plurality of images D21, D22 from the server 2, and sequentially displays the images D21, D22 on the screen of the display 1i. The period for switching the images D21, D22 to be displayed is ten seconds, according to the example of the HTML file shown in Figs. 6 and 7. The contents of the voices V21, V22 output from the speaker 1h based on the voice data file received by the information processing terminal 1 are synchronized with the transition of the images D21, D22 displayed on the display 1i.

[0047] When the information processing terminal 1 is displaying an image D22, if the user performs an operation to select the image D22, for example, an operation to tap or click directly above or near the image D22 on the screen, the information processing terminal 1 requests the server 2 indicated by the URL corresponding to the image D22 to transmit data to output some information, and receives a data file from the server 2. Then, based on the received data file, the information processing terminal 1 outputs a voice and / or an image W and provides it to the user. FIG. 11 shows an example of an image W displayed and output on the screen of the display 1i of the information processing terminal 1 as a result of the image D22 being selected by the user, and is a website of an e-commerce site that sells an item in which the user is interested. In this way, according to the present system and method, it is possible to induce access to the server 2 that provides information associated with the contents published in the printed matter or publication, additional information, development information, and the like.

[0048] FIG. 12 shows an instruction manual P2 as an example of a printed matter or publication that a user reads. A sheet or page of the instruction manual P2 has multiple areas, and each area contains individual content. The content of each area is text, pictures, diagrams, tables, photographs, or a combination of these, and is printed on the paper to convey some information to the user who reads it. Therefore, individual codes Q5, Q6, and Q7 are printed for each area near the content of each area. The codes Q5, Q6, and Q7 corresponding to each area record different URLs.

[0049] A user reading the instruction manual P2 has the information processing terminal 1 read any one of the codes Q5, Q6, and Q7 attached to each area. The information processing terminal 1 then transmits a request to the server 2 specified by the URL recorded in the read code Q5, Q6, and Q7, and the server 2, upon receiving the request, transmits data for outputting audio and images on the information processing terminal 1, in this embodiment, an HTML file, an audio file, an image file, and the like, to the information processing terminal 1. The information processing terminal 1 receives each data file, and outputs audio V5, V6 and images D5, D6 related to the contents of the area corresponding to the read code Q5, Q6, and Q7. The contents of the data received by the information processing terminal 1, i.e., the contents of the audio V5, V6 and images D5, D6 output by the information processing terminal 1, may vary depending on the code Q5, Q6, and Q7 read by the information processing terminal 1.

[0050] 13 shows an example in which the information processing terminal 1 reads the code Q5 on the page and outputs information on a voice V5 and an image D6 provided by the server 2, and an example in which the information processing terminal 1 reads the code Q6 on the page and outputs information on a voice V6 and an image D6 provided by the server 2. These correspond to the published contents corresponding to the codes Q5 and Q6 on the page, respectively.

[0051] The application of the present system and method is, of course, not limited to the above-mentioned P1 and P2. Examples of applicable printed matter or publications include: Reading picture books: A code is assigned to each page of a picture book, or to each of a number of areas on each page, and when any of the codes is read by the information processing terminal 1, a voice is output from the information processing terminal 1 reading aloud the text printed on the page or area corresponding to the code. Language learning materials: A code is assigned to each page of the learning materials, or to each of multiple areas on each page, and when any of the codes is read by the information processing terminal 1, a voice in which a native speaker reads aloud the sentences, words, etc. printed on the page or area corresponding to the code is output from the information processing terminal 1. Comic book with audio: A code is assigned to each page of a comic book, to each group of frames (for example, one work of a four-frame comic strip), or to each frame, and when any of the codes is read by the information processing terminal 1, audio is output from the information processing terminal 1 that reads out the lines printed on the page or frame that corresponds to the code. Onomatopoeia or sound effects may also be output. Posters, flyers, cards, pamphlets, etc.: A code is attached to each of a number of areas on the paper, and when any of the codes is read by the information processing terminal 1, a voice related to the content printed in the area corresponding to the code is output from the information processing terminal 1. For example, the voice could be an explanation of the content published in a pamphlet distributed by a government agency to citizens, the actual voice of a person published in a poster, or a voice introducing or advertising a product published in the poster. It could also be a sticker or card attached to agricultural products that allows the producer's voice to be heard.

[0052] According to the system and method of this embodiment, audio related to the published contents can be delivered "just now" to a user reading the printed matter or publication P1, P2. In other words, the user can listen to the audio while reading the printed matter or publication P1, P2. The operations that the user must perform at that time are also simple. This enables the user to have a deeper understanding of the published contents and to arouse the user's strong interest and concern in the published contents. As a result, the utility and added value of the published matter or editions of the publication P1, P2 can be further increased.

[0053] The amount of data transmitted between the information processing terminal 1 and the server 2 is kept to a minimum, including voice and image files. Therefore, the communication bandwidth is not overloaded, and information can be presented to the user in the form of voice and / or images with a quick response. Currently, many users of the mobile communication terminal 1 generally have contracts with telecommunications carriers (communication line carriers, communication carriers, mobile phone companies) that set an upper limit on the amount of data that can be transmitted and received per month, from the perspective of cost performance. In this type of contract, if the accumulated amount of data received during the month exceeds the upper limit, a measure is usually taken to forcibly reduce the communication speed (amount of data transferred per unit time) until the end of the month, and therefore users do not like to transmit and receive unnecessarily large amounts of data. The system and method of the present invention have the advantage of not increasing the amount of data transmitted and received unnecessarily, and being able to provide necessary information quickly even with a small communication bandwidth; it is not necessary to transmit and receive large amounts of video data such as those provided by well-known video distribution sites.

[0054] On the server 2 side, it is not required to construct a website with a complex structure.

[0055] The present invention is not limited to the embodiment described above in detail. In particular, the functions of the units shown in Fig. 4 may be distributed among multiple computers, and the solutions support system according to the present invention may be realized by the cooperation of the multiple computers.

[0056] In addition, the specific configuration of each part and the processing procedure can be modified in various ways without departing from the spirit of the present invention. [Explanation of symbols]

[0057] 1...Information processing terminal 101...Reading unit 102...Request transmission unit 103...Data receiving unit 104...Output section 105...Input reception section 2. Server 201...Data storage section 202...Request receiving unit 203...Data transmission unit D1, D21, D22, D5, D6…Images P1, P2: Printed matter or publication Q1, Q2, Q3, Q4, Q5, Q6, Q7…Code V1, V21, V22, V5, V6...Audio W: Related information (web page to which the user is redirected)

Claims

1. The device includes an information processing terminal used by a user who reads the contents printed on the paper of a printed matter or publication, and a server storing data for outputting information related to the contents of the printed matter or publication by voice, The information processing terminal, A reading unit that reads a code printed in a location adjacent to the contents on the surface of the printed matter or publication; a request transmission unit for requesting a server indicated by a URL recorded in the code read by said reading unit to transmit data for outputting information related to the contents of said printed matter or publication by voice; a data receiving unit that receives the data transmitted from the server in response to a request made by the request transmitting unit; an output unit that outputs information related to the contents of the printed matter or publication by voice based on the data received by the data receiving unit, The server, a request receiving unit for receiving a request from the information processing terminal; a data transmission unit that transmits the data corresponding to the request received by the request receiving unit to the information processing terminal.

2. The printed matter or publication has areas in which a plurality of contents are printed on a single sheet, a single page, or the left and right pages of a two-page spread, and a code in which a different URL is recorded is printed for each of the areas, a data transmission unit of the server transmitting, to the information processing terminal, the data that differs depending on the code read by the information processing terminal used by the user; 2. The system for providing information related to published content as described in claim 1, wherein the output unit of the information processing terminal outputs different information by voice for each area in which the published content is printed in the printed matter or publication based on the data received by the receiving unit.

3. the server stores data for outputting information related to the contents of the printed matter or publication in one or more images; a request transmission unit of the information processing terminal requests a server indicated by a URL recorded in the code read by the reading unit to transmit data for outputting information related to the contents of the printed matter or publication in the form of voice and one or more images; a data transmission unit of the server transmitting the data corresponding to the request received by the request reception unit to the information processing terminal; 3. The system for providing information related to published contents as described in claim 1 or 2, wherein the output section of the information processing terminal outputs information related to the published contents of the printed matter or publication as voice and one or more images based on the data received by the data receiving section.

4. the data transmitted by the data transmission unit of the server and received by the data reception unit of the information processing terminal includes information of a URL corresponding to each image output by the output unit of the information processing terminal; the information processing terminal includes an input receiving unit configured to receive an operation by a user to select one or more images to be output by the output unit; The content related information providing system according to claim 3, wherein the request sending unit of the information processing terminal requests the sending of data to output some information to a server indicated by a URL corresponding to an image selected by an operation received by the input receiving unit.

5. The system for providing information related to published contents according to claim 1 is used to realize the system, A printed matter or publication on whose page the contents to be read by a user are printed and on which a code recording a URL is printed in a location adjacent to the contents on the page; A combination of a server and a request receiving unit that receives a request for sending data for outputting information related to the contents of the printed matter or publication in audio form, the request being provided from the information processing terminal used by the user by reading a code printed on the printed matter or publication, and a data transmitting unit that transmits the data corresponding to the request received by the request receiving unit to the information processing terminal.

6. A step in which an information processing terminal used by a user who reads the contents printed on the surface of a printed matter or publication reads a code printed in a location adjacent to the contents on the surface of the printed matter or publication; a step of the information processing terminal requesting a server indicated by a URL recorded in the read code to transmit data for outputting information related to the contents of the printed matter or publication by voice; said server receiving a request coming from said information processing terminal; a step of the server transmitting the data corresponding to the request received by the request receiving unit to the information processing terminal; receiving, by the information processing terminal, the data transmitted from the server in response to the request; a step of outputting information related to the contents of the printed matter or publication by voice, based on the received data, by the information processing terminal; A method for providing information related to published content, comprising:

Images