Content delivery device, content delivery method, program, and recording medium

The content providing device addresses the issue of incorrect content positioning by associating and identifying the content storage location from scanned images, ensuring accurate display on the screen.

JP2026183114APending Publication Date: 2026-11-19FUJIFILM CORP
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2026207044
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2022-02-25
Filing Date
2026-09-16
Publication Date
2026-11-19

AI Technical Summary

Technical Problem

Existing technologies fail to accurately display augmented reality content on a display screen due to variations in the relative position of markers on printed materials, which can occur based on the size of the printed medium, leading to incorrect content positioning.

Method used

A content providing device that sets a target image as a reference, associates content with this image, prints additional images on a designated medium, reads the printed material, identifies the content storage location from the scanned image, and transmits display data to correctly position the content on the display screen.

Benefits of technology

Ensures accurate and appropriate display of content by aligning it with the target image on the display screen, regardless of the printed medium's size, enhancing user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026183114000001_ABST
    Figure 2026183114000001_ABST
Patent Text Reader

Abstract

This invention provides a content delivery device, a content delivery method, a program, and a recording medium that can appropriately display content provided by reading printed images acquired via a network. [Solution] In this invention, a first image provided by a first user is associated with content displayed on the display screen of a second user's terminal. Print data is sent to the terminal to print the first image and a second image related to the content onto a specified medium designated by the first user. When the printed material generated by printing the first image onto the specified medium according to the print data is read by the terminal, the read image of the read print material is received from the terminal, and the above-mentioned content is displayed on the display screen at a position corresponding to the portion of the read image that corresponds to the first image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a content providing apparatus, a content providing method, a program, and a recording medium that provide content triggered by reading an image printed on a medium.

Background Art

[0002] With the spread of network communication technology, images can be exchanged between users, and an image provided by one user can be printed on the other user's side (for example, see Patent Document 1).

[0003] In addition, for reasons such as promoting the printing of provided images, when a printed image is read by a reading device, content may be provided triggered by that operation (for example, see Patent Document 2). Patent Document 2 describes that by capturing (capturing an image of) a printed matter or the like with an information terminal such as a smartphone, predetermined video content is composited and displayed on the video of the printed matter displayed on the information terminal. That is, according to the technique described in Patent Document 2, content for Augmented Reality (AR) is provided.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of Invention

Problems to be Solved by the Invention

[0005] In the technology described in Patent Document 2, the content provided upon scanning a printed document is displayed at a position determined based on a portion of the image printed on the document (a so-called marker). In other words, on the display screen of the information terminal that photographs the printed document, the content is displayed at a position corresponding to the position of the marker.

[0006] On the other hand, the position of the marker relative to the printed material (more specifically, the relative position between the printed material and the marker) may change depending on, for example, the size of the medium on which the image is printed. Therefore, if the size of the medium used to print the image is not appropriate, the content displayed by photographing (capturing) that print may not be displayed correctly on the display screen.

[0007] The present invention has been made in view of the above circumstances, and specifically aims to provide a content provisioning device, a content provisioning method, a program, and a recording medium that can appropriately display content provided by reading a printed document when an image acquired via a network is printed. [Means for solving the problem]

[0008] To achieve the above objective, the present invention provides a content providing device equipped with a processor, wherein the processor performs the following processes: setting at least a portion of a target image provided by a first user as a first image; saving content displayed on the display screen of a second user's terminal in association with the first image; transmitting print data to the terminal for printing the target image and a second image corresponding to the content storage location onto a designated medium specified by the first user; receiving a scanned image of the scanned print from the terminal when the printed material generated by printing the target image and the second image onto the designated medium according to the print data is read by the terminal; identifying the storage location from the portion of the scanned image corresponding to the second image; and transmitting display data to the terminal for displaying the content stored at the storage location at a position on the display screen corresponding to the portion of the scanned image corresponding to the first image.

[0009] Furthermore, the above-mentioned processor may, in the process of transmitting display data, transmit to the terminal display data that displays the content in a state where the content has been combined with the read image displayed on the display screen.

[0010] Furthermore, the above-mentioned processor may perform a process to receive configuration information from the first terminal that indicates the settings for displaying content. In this case, the above-mentioned processor may send display data to the terminal that displays the content according to the settings.

[0011] Furthermore, in the process of transmitting display data, the above-mentioned processor may transmit to the terminal display data that displays content stored in the storage location and set by the first user.

[0012] Furthermore, in the process of sending print data, the above-mentioned processor may send print data to the terminal that causes the target image and the second image to be printed on a specified medium of a size specified by the first user.

[0013] Furthermore, the number of times display data can be sent may be stored in a memory device for each user. In this case, the processor may perform a process to reduce the number of times a second user can send data depending on the number of times the process of sending display data to the terminal has been executed. Also, if the remaining number of times a second user can send data is 0, the transmission of display data to the terminal may be restricted.

[0014] Furthermore, whether or not payment has been made for the displayed data may be stored in the storage device. In this case, the processor may send the displayed data to the terminal of the second user who has paid the fee.

[0015] Furthermore, the above-mentioned processor may perform a process to transfer at least a portion of the fees paid by the second user to a designated recipient.

[0016] Furthermore, the above processor may perform a process to update the content stored in the destination location in association with the first image, and in the process of sending display data to the terminal after the content has been updated, it may also send display data that displays the updated content at the above location.

[0017] Alternatively, the first user may use the first terminal, and the second user may use the second terminal, and the first terminal may acquire printer information regarding the printer that the second user uses when printing images. In this case, the processor may send print data to the second terminal to print the target image and the second image on a specified medium corresponding to the printer information acquired by the first terminal.

[0018] Furthermore, in order to solve the aforementioned problems, the content provision method of the present invention is characterized in that a processor performs the following steps: setting at least a part of a target image provided by a first user as a first image; saving content displayed on the display screen of a second user's terminal in association with the first image; transmitting print data to the terminal for printing the target image and a second image corresponding to the content storage location on a designated medium specified by the first user; receiving a read image from the terminal when a printed material generated by printing the target image and the second image on the designated medium according to the print data is read by the terminal; identifying the storage location from the portion of the read image corresponding to the second image; and transmitting display data to the terminal for displaying the content stored at the storage location at a position on the display screen corresponding to the portion of the read image corresponding to the first image.

[0019] Furthermore, in the process of transmitting display data, the above-mentioned processor may transmit to the terminal display data that displays the content in a state where the content has been combined with the read image displayed on the display screen.

[0020] Furthermore, the above-mentioned processor may perform a step of acquiring configuration information that indicates the settings for displaying content. In this case, in the step of transmitting display data, the above-mentioned processor may transmit display data that displays content according to the settings to the terminal.

[0021] Furthermore, the above processor may also perform the process of updating the content stored in the destination location in association with the first image. In this case, in the process of sending display data to the terminal after the content has been updated, the above processor should send display data that displays the updated content at the above location.

[0022] Furthermore, according to the present invention, a program for causing a computer to execute each step included in the content providing method described above can be realized. Moreover, according to the present invention, a computer-readable recording medium on which a program for causing a computer to execute each step included in the content providing method described above is recorded can be realized. [Effects of the Invention]

[0023] According to the present invention, when an image acquired via a network is printed, content provided by reading the printed matter can be appropriately displayed. [Brief Description of the Drawings]

[0024] [Figure 1A] It is a diagram showing a first example of content. [Figure 1B] It is a diagram showing a second example of content. [Figure 1C] It is a diagram showing a third example of content. [Figure 1D] It is a diagram showing a fourth example of content. [Figure 2A] It is a diagram (part 1) showing the procedure of content provision. [Figure 2B] It is a diagram (part 2) showing the procedure of content provision. [Figure 3] It is a diagram showing a printed matter. [Figure 4] It is a diagram showing the configuration of a content providing system. [Figure 5] It is a diagram showing the hardware configuration of a content providing apparatus according to one embodiment of the present invention. [Figure 6] It is a diagram showing an example of management data stored in a storage device. [Figure 7] It is an explanatory diagram of functions of the content providing apparatus according to one embodiment of the present invention. [Figure 8] It is a diagram (part 1) showing a content providing flow according to one embodiment of the present invention. [Figure 9]This figure (part 2) shows a content delivery flow according to one embodiment of the present invention. [Figure 10] This diagram shows the content update flow. [Modes for carrying out the invention]

[0025] One embodiment of the present invention (hereinafter referred to as "this embodiment") will be described with reference to the drawings. However, the embodiment described below is merely an example given to facilitate understanding of the present invention and does not limit the present invention. Furthermore, the present invention may be modified or improved from the following embodiment without departing from its spirit. In addition, the present invention includes equivalents thereof.

[0026] In this specification, the concept of "device" includes both a single device that performs a specific function on its own, and multiple devices that exist independently and in a distributed manner while cooperating (linking) to perform a specific function.

[0027] Furthermore, in this specification, "image" refers to image data unless otherwise specified. Examples of image data include lossy compressed image data such as JPEG (Joint Photographic Experts Group) format, and lossless compressed image data such as GIF (Graphics Interchange Format) or PNG (Portable Network Graphics) format.

[0028] Furthermore, in this specification, "user" refers to a user who utilizes the content provisioning device of the present invention. Utilizing the content provisioning device means utilizing the functions of the content provisioning device, and includes not only directly operating the content provisioning device but also utilizing the functions of the content provisioning device from other devices (for example, a terminal owned by the user). Furthermore, users can be individuals, groups including multiple people such as families, corporations or other legal entities, or institutions or other organizations.

[0029] <Content provision service> The services (hereinafter referred to as "content provision services") realized by the content provision device and content provision method according to this embodiment will now be described. A user (first user) can provide content to other users (second users) through the content provision services. The second user can receive and use the content provided by the first user in response to their request through the content provision services.

[0030] The content is digital content, and in particular, content that can be displayed on a display device such as a screen. In this embodiment, augmented reality content (hereinafter referred to as AR content) is provided. That is, on the side of the second user to whom the AR content is provided, when real-world video (more specifically, real-time video) captured by a camera or the like is displayed on the screen, the AR content is superimposed on the video and displayed.

[0031] AR content may be content A1 consisting of text (messages), as shown in Figure 1A, or content A2 consisting of video or imagery, as shown in Figure 1B. AR content may also be content A3 consisting of illustrations drawn using computer graphics, as shown in Figure 1C. Furthermore, AR content may be content A4 that is composited with other video to add a background effect (in Figure 1D, a rain effect). The content may be displayed in a static state, in a moving state like a video, or with accompanying audio output.

[0032] Referring to Figures 2A and 2B, the procedure for providing and using AR content is outlined as follows: First, the first user transmits the images necessary for content provision (hereinafter referred to as "target images"). Here, "the first user transmits the target images" means that the target images are transmitted from the information processing terminal used by the first user (hereinafter referred to as "first terminal 11"), specifically meaning the uploading of the target images. The target images are provided by the first user and are one or more images specified from the image group owned by the first user, for example, images purchased by the second user from the first user.

[0033] Furthermore, as shown in Figure 2A, the first user sets the AR content to be provided and also sets the conditions (display conditions) for displaying that AR content on the second user's side. Setting AR content means creating new AR content or selecting one of several types of AR content that have been prepared in advance.

[0034] The display conditions for AR content refer to the settings related to the display of AR content, such as the display size, display position, and orientation of the AR content when displayed on the second user's side. Here, the display position is determined using the position of the first image, which will be described later, as the reference position.

[0035] The content provision service generates printable data based on the target image sent by the first user and information about the AR content set by the first user (specifically, the storage location of the AR content). The printable data is data for printing the image used to obtain the content. The generated printable data is sent to the second user as shown in Figure 2A. Here, "sending printable data to the second user" means sending the data to the information processing terminal (corresponding to a terminal, hereinafter referred to as the second terminal 12) used by the second user.

[0036] When the second user (specifically, the second terminal 12) receives print data, it prints the content acquisition image according to the print data. The device used to print the content acquisition image is, for example, a printer owned by the second user (specifically, the portable printer 13 described later). However, it is not limited to this, and a printing device that the second user does not own, such as a device installed in a store, may also be used, which can be accessed by entering a PIN or account information to log in.

[0037] When the image for obtaining the content is printed, the printed material P shown in Figure 3 is generated. The printed material P is a medium (for example, a photosensitive film F described later) on which the target image and the identification image are printed.

[0038] Furthermore, as shown in Figure 3, the image-forming surface of the printed object P includes a target image region Pa and a second image region Pb. Within the target image region Pa, the printed target image (i.e., a visualized image of the target image) exists on the image-forming surface.

[0039] Furthermore, the target image region Pa contains a region corresponding to the first image set in the target image (hereinafter referred to as the first image region). The first image is a template image used when displaying AR content, and is composed of part or all of the target image. The template image functions as a marker that is tracked when the AR content is displayed. In the case shown in Figure 3, for example, the face of the subject in the target image is set as the template image.

[0040] The second image area Pb is an area on which an optically readable second image, such as a QR code (registered trademark), is printed. The second image is an image generated according to the storage location of the AR content set by the first user, and more specifically, it is an image obtained by encoding (barcoding) the storage location. Note that the second image is not limited to an encoded image such as a QR barcode (registered trademark), but can be any readable image, such as characters, symbols, numbers, or encrypted characters. Furthermore, the second image may include encrypted information, such as information encrypted to identify the first image within the target image.

[0041] The second image region Pb may be located in a position overlapping with the target image region Pa, as shown in Figure 3, or it may be located at a position away from the target image region Pa. In this case, it is preferable that the second image region Pb is located near the target image region Pa.

[0042] Then, as shown in Figure 3, the second user reads the printed material P using the second terminal 12 equipped with a reading function. Reading the printed material P means acquiring a read image of the printed material P, and the read image represents the density (more specifically, the grayscale value) of the printed material P for each pixel, and is acquired by reading the printed material P. To put it simply, capturing the printed material P with a shooting device corresponds to reading the printed material P, and the captured image (real-time image) corresponds to the read image.

[0043] When the printed document P is read, the scanned image is sent from the second user, as shown in Figure 2B. At this stage, the display screen of the second terminal 12 shows the scanned image, i.e., a real-time image of the printed document P.

[0044] In the content delivery service, the storage location of the AR content set by the first user is identified based on the portion of the scanned image sent by the second user that shows the second image region Pb (i.e., the portion corresponding to the second image). Then, display data for displaying the AR content stored in the identified storage location is sent to the second user (i.e., downloaded). The display data is received by the second terminal 12. As a result, the AR content is provided to the second user.

[0045] As shown in Figures 1A to 1D, the AR content is superimposed on the scanned image and displayed on the display screen of the second terminal 12, which has received the display data. At this time, the AR content is displayed according to the display conditions set by the first user, specifically, it is displayed with the display size, display position, and orientation specified by the first user. In particular, the display position of the AR content is determined according to the portion of the display screen that shows the first image area (i.e., the portion corresponding to the first image in the scanned image). As a result, the AR content is displayed on the display screen while maintaining a constant positional relationship with the portion that shows the first image area.

[0046] According to the content provision service described above, for example, the first user sells an image, the second user purchases the image (target image) from the first user, prints the purchased image, and obtains a printed item P. When the second user reads the printed item P with the second terminal 12, the AR content set by the first user is superimposed on the scanned image and displayed on the display screen of the second terminal 12. This allows the second user to use the AR content provided through the content provision service.

[0047] Regarding the content provision service, it should be noted that the use of the AR content provision service may be paid or free. In this embodiment, the service is paid, and the second user can use the AR content (more precisely, the display data for the AR content) only if they pay the fee for the AR content, that is, they can display the AR content on the second terminal 12.

[0048] Furthermore, part or all of the fees for the AR content paid by the second user may be sent to the first user who sold the image, or it may be sent to a designated recipient other than the first user. Examples of designated recipients other than the first user include businesses that operate content provision services. With the above configuration, the fees for the AR content paid by the second user can be distributed between the first user and the service provider.

[0049] Furthermore, certain restrictions may be placed on the provision of AR content to a second user, i.e., the transmission of display data for AR content. For example, the period during which AR content can be provided to a second user may be limited to a certain period after the second user purchases the image (target image) from the first user. Also, a limit may be set on the number of times the display data for AR content can be transmitted, and AR content may be provided to the second user until the remaining number of transmissions set for the second user reaches zero. Conversely, if the remaining number reaches zero, the provision of AR content to the second user may be restricted (terminated).

[0050] Furthermore, the content provided to the second user by scanning the printed document P may be the same content, or it may change depending on when it is scanned. In other words, the content provided by scanning the same printed document P may be updated depending on the time, etc.

[0051] <Content Delivery System> Next, referring to Figure 4, we will describe the configuration of the communication system, or content provision system S, that is built to realize the content provision service. As shown in Figure 4, the content delivery system S consists of a server computer 10, a first terminal 11, a second terminal 12, and a portable printer 13, etc. The following describes each device.

[0052] (Server computer) The server computer 10 is a computer that forms the platform for the content provision service and constitutes the content provision device 20 of the present invention. The server computer 10 may be a server for cloud services, specifically a server computer for ASP (Application Service Provider), SaaS (Software as a Service), PaaS (Platform as a Service), or IaaS (Infrastructure as a Service).

[0053] The server computer 10 can communicate with the first terminal 11 and the second terminal 12 via an external network N such as the Internet or a mobile communication network, and acquires various information from these devices. The acquired information is stored in the storage device 14, and the server computer 10 can read the information stored in the storage device 14. The storage device 14 is composed of, for example, storage built into or attached to the server computer 10, or a NAS (Network Attached Storage). However, it is not limited to this, and the storage device 14 may be a third computer that can communicate with the server computer 10, for example, so-called online storage.

[0054] The server computer 10 then performs various information processing related to the content provision service. Specifically, the server computer 10 generates printable data for content acquisition images and transmits this data to the second user (see Figure 2A). The server computer 10 also generates display data for AR content and transmits this data to the second user (see Figure 2B).

[0055] (Terminal 1) The first terminal 11 is a device operated by the first user and consists of a PC (Personal Computer) or workstation, a smartphone, and a tablet device, etc. The first terminal 11 accepts operations performed by the first user in order to use the content provision service. Operations accepted by the first terminal 11 include, for example, image selection operations, print condition selection operations, AR content setting operations, and display condition setting operations.

[0056] The image selection operation is the operation in which the first user selects the image to send (transfer) to the second user from a group of images owned by the first user. The image selection operation may also include editing operations such as cropping or other image processing, or image quality adjustment, applied to the selected image. When the first terminal 11 receives an image selection operation, it sends the target image specified in that operation to the server computer 10. At this time, the target image or edited image is sent associated with the ID information of the first user (more precisely, the first terminal 11).

[0057] The print condition specification operation is the operation to set the print conditions when a second user prints the content acquisition image containing the target image. Specifically, the first user specifies the second user who will perform the printing and the medium on which the content acquisition image will be printed (hereinafter referred to as the specified medium) as the print conditions. In addition, the print conditions may also include, for example, the layout of the target image and the second image in the content acquisition image, as well as the print size of each image. In this embodiment, the first user confirms in advance the ID information of the second user (more precisely, the second terminal 12) and the type of portable printer 13 used by the second user, and sets the print conditions after understanding this information. When the first terminal 11 receives the print condition specification operation, it transmits the print condition information specified by the first user (hereinafter referred to as "specified information") to the server computer 10. At this time, the specified information is transmitted in association with the ID information of the first user (more precisely, the first terminal 11). Here, when the first user specifies the print conditions, this includes not only the case where the first user specifies the printer conditions by operating the first terminal 11, but also the case where the printer conditions are automatically specified by the first terminal 11 used by the first user, as described later.

[0058] The method for obtaining information regarding the type of the second user's portable printer 13 and print size (hereinafter referred to as "printer information") is not limited to the method described above. For example, the printer information may be stored in the second terminal 12, or stored in the server computer 10 in association with the second user's ID information. In this case, the first terminal 11 may obtain the printer information by communicating with the second terminal 12 or the server computer 10. Alternatively, the first terminal 11 may automatically set print conditions, including the specified medium, based on the acquired printer information.

[0059] The AR content setting operation is the operation of setting the AR content to be provided to the second user. For example, if the AR content is a message, it is the operation of creating (inputting) that message. If multiple candidates for the AR content are prepared in advance, the first user may perform the AR content setting operation by selecting one or more candidates. When the first terminal 11 receives an AR content setting operation, it transmits the AR content set (more specifically, created or selected) by the first user to the server computer 10. At this time, the AR content is transmitted in association with the ID information of the first user (more precisely, the first terminal 11).

[0060] The display condition setting operation is an operation that sets the display conditions when a second user displays AR content. Specifically, it sets the display size, display position, and orientation of the AR content. When the first terminal 11 receives a display condition setting operation, it transmits the display condition information (hereinafter referred to as "setting information") set by the first user to the server computer 10. At this time, the setting information is transmitted in association with the ID information of the first user (more precisely, the first terminal 11).

[0061] (Second terminal) The second terminal 12 is a device operated by a second user and equipped with a reading function, and more specifically, it consists of a smartphone or tablet device equipped with a camera or other photographic device. The second terminal 12 accepts operations performed by the second user to use the content provision service. Operations accepted by the second terminal 12 include, for example, purchase operations, payment operations, and reading instruction operations.

[0062] The purchase operation is performed when a second user purchases an image from the first user. Upon receiving the purchase operation, the second terminal 12 sends information to the server computer 10 to identify the image to be purchased. This information to identify the image to be purchased is associated with the ID information of the second user (more precisely, the second terminal 12) and sent from the server computer 10 to the first terminal 11.

[0063] The payment operation is the operation performed when a second user pays for AR content (specifically, the fee for the display data of the AR content), i.e., a settlement operation. When the second terminal 12 receives a purchase operation, it sends information regarding the payment of the fee to the server computer 10.

[0064] The read command operation is performed when a second user commands the reading of a printed document P. When the second terminal 12 receives the read command operation, the second terminal 12's reading device (i.e., the imaging device) is activated. Then, with the imaging unit (specifically, the imaging lens) of the reading device pointed towards the printed document P, the reading (imaging) of the printed document P begins. As a result, a live video of the read image is displayed on the display screen of the second terminal 12. The second terminal 12 also transmits the read image to the server computer 10. At this time, the read image is transmitted in association with the ID information of the second user (more precisely, the second terminal 12).

[0065] Furthermore, when the second terminal 12 receives print data from the server computer 10, it controls the portable printer 13 according to the print data and prints the content acquisition image to the portable printer 13. The second terminal 12 may also inquire with the second user whether printing is necessary. In this case, the second terminal 12 should print the content acquisition image to the portable printer 13 only if the second user responds that printing is necessary.

[0066] Furthermore, when the second terminal 12 receives display data for AR content from the server computer 10, it expands the display data and displays the AR content. At this time, the AR content is displayed on the display screen of the second terminal 12 according to the display conditions set by the first user. Specifically, the AR content is superimposed on the scanned image of the printed material P displayed on the display screen. At this time, the AR content is displayed in the display position, size, and orientation set by the first user. In particular, the display position of the AR content on the display screen is determined according to the portion of the scanned image that captures the first image area.

[0067] (Portable printer) The portable printer 13 is a device used by a second user to print images for content acquisition, and is wirelessly connected to the second terminal 12 via Wi-Fi® or Bluetooth®. However, it is not limited to this, and the portable printer 13 may also be connected to the second terminal 12 via a wired connection. Then, the portable printer 13 prints the image under the control of the second terminal 12.

[0068] The portable printer 13 of this embodiment prints images using an instant photo method. Specifically, the portable printer 13 houses a photosensitive film and exposes the image-forming surface of the photosensitive film to light to form a latent image. Next, the portable printer 13 breaks a developer pot located at the edge of the film, releasing the developer onto the film surface and making the latent image visible. After this process, the photosensitive film is ejected from the printer, development proceeds, and finally a complete image is formed on the image-forming surface of the photosensitive film. This forms the printed object P. Furthermore, the image printing method is not limited to instant photography; inkjet, dye-sublimation thermal transfer, or toner-based electrophotography methods may also be used.

[0069] The photosensitive film is the medium on which the image is printed, and it is a film specifically for the portable printer 13. Furthermore, there are multiple sizes of photosensitive film available for use with the portable printer 13, and the type of film used is determined according to the type of portable printer 13. Specifically, in this embodiment, there are multiple types of portable printers 13, and the size of the photosensitive film is determined to be one of these sizes depending on the type of portable printer 13 used by the second user.

[0070] In this embodiment, even when printing the same image, the size of the printed image changes if the size of the photosensitive film is different. Therefore, when an image for obtaining content is printed on a photosensitive film, the size of the target image area Pa, in other words, the position of the first image, changes according to the size of the photosensitive film. For this reason, when a second user prints an image for obtaining content, it is necessary to specify the type (size) of photosensitive film to be used by the second user. Therefore, in this embodiment, print data is generated according to the specified type of photosensitive film (corresponding to the specified medium), and the generated data is transmitted to the second user, or more specifically, to the second terminal 12.

[0071] <Example of content delivery device configuration> Next, an example of the configuration of the content provisioning device 20 according to this embodiment will be described. As mentioned above, the content provisioning device 20 according to this embodiment is composed of a server computer 10. The number of computers that make up the content provisioning device 20 may be one or two or more. In other words, the content provisioning device 20 is realized by a processor and a program that the processor can execute, and is composed of, for example, a general-purpose computer.

[0072] As shown in Figure 5, the server computer 10 that constitutes the content provisioning device includes a processor 10A, memory 10B, communication interface 10C, and the like.

[0073] The processor 10A is composed of, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), or a TPU (Tensor Processing Unit). Memory 10B is composed of semiconductor memory such as ROM (Read Only Memory) and RAM (Random Access Memory). The communication interface 10C is configured, for example, by a network interface card or a communication interface board.

[0074] Furthermore, the server computer 10 has a program installed that allows it to function as a content provisioning device according to the present invention (hereinafter referred to as the content provisioning program). The content provisioning program is a program that causes the computer to execute each step included in the content provisioning method of the present invention. That is, the processor 10A reads the content provisioning program and executes a series of processes related to the content provisioning service described above.

[0075] The content provision program may be obtained by reading it from a computer-readable storage medium, or by receiving (downloading) it via a communication line such as the Internet or an intranet.

[0076] The content provider 20 is connected to the storage device 14 and can read information stored in the storage device 14. The storage device 14 stores information necessary for the content provision service, such as information or images acquired by the content provider 20 from the first terminal 11 and the second terminal 12. The storage device 14 also stores management data for each user to manage usage history of the content provision service.

[0077] The management data includes information about users of the content provision service, information about the AR content provided, and information about the content provision history. More specifically, as shown in Figure 6, the management data includes the ID information of the first user's first terminal 11, the storage location of the AR content set by the first user, and the ID information of the second user's second terminal 12 to which the AR content is provided. The management data also includes printer information indicating the type of portable printer 13 used by the second user. Furthermore, the management data includes information about the second user regarding whether payment has been made for the AR content, the amount paid, the period during which the AR content can be provided, and the number of times it can be provided.

[0078] The configuration of the content provision device 20 will be explained again from a functional standpoint with reference to Figure 7. The content provision device 20 includes a first receiving unit 21, a setting unit 22, a second receiving unit 23, a storage unit 24, a third receiving unit 25, a fourth receiving unit 26, a first transmitting unit 27, a fifth receiving unit 28, a specific unit 29, and a second transmitting unit 30. The content provision device 20 also includes a determination unit 31, a restriction setting unit 32, an update unit 33, and a remittance processing unit 34. These functional units are realized through the cooperation of hardware equipment provided by the server computer 10 and software including the aforementioned content provision program.

[0079] The first receiving unit 21 receives the target image transmitted from the first terminal 11. The received target image is stored, for example, in the storage device 14.

[0080] The setting unit 22 sets a first image for the target image acquired by the first receiving unit 21. In this case, the setting unit 22 sets a part or all of the target image as the first image. For example, if a person is in the target image, the person's face may be set as the first image. The first image may be set based on a part of the target image indicated by the first user, or it may be set automatically by the setting unit 22.

[0081] The second receiving unit 23 receives the AR content set by the first user and provided to the second user (i.e., the content displayed on the display screen of the second terminal 12). If the first user selects one or two candidates from multiple candidates to set the AR content, the second receiving unit 23 receives the selection result.

[0082] The storage unit 24 stores the AR content received by the second receiving unit 23, associating it with the first image set by the setting unit 22. The storage location for the AR content is not particularly limited and may be, for example, the storage device 14. Furthermore, from the viewpoint of reducing the data capacity in the content providing device 20, the storage device 14 other than the content providing device 20 is preferred as the storage location for the AR content. Furthermore, the storage unit 24 generates a second image (for example, a code image such as a QR code (registered trademark)) corresponding to the storage location of the AR content.

[0083] The third receiving unit 25 receives and acquires setting information from the first terminal 11, which indicates the settings (settings) that the first user has set regarding the display conditions for the AR content. The display conditions indicated by the setting information include the display size, display position, and orientation of the AR content. The display position is determined based on the first image mentioned above.

[0084] The fourth receiving unit 26 receives specification information from the first terminal 11 indicating the print conditions specified by the first user for the content acquisition image, which includes the target image and the second image. The print conditions indicated by the specification information include the size of the photosensitive film on which the content acquisition image will be printed (in other words, the type of portable printer 13), the layout of the target image and the second image, and the print size of each image. The specification information also includes the ID information of the second user who will have the content acquisition image printed.

[0085] The first transmitting unit 27 generates print data and transmits it to the second terminal 12. The print data is data for printing the content acquisition image according to the print conditions indicated by the specified information received by the fourth receiving unit 26. When the first transmitting unit 27 transmits the print data, the content acquisition image is printed on a photosensitive film of the type (size) specified by the first user on the second user's side. Furthermore, the print data cannot be modified (overwritten) on the second terminal 12. In other words, the second user can only print the content acquisition image if they use a photosensitive film of the size specified by the first user.

[0086] The fifth receiving unit 28 receives the scanned image of the printed material P from the second terminal 12. The printed material P is generated when a content acquisition image is printed according to the print data described above, and the scanned image is obtained when the second user reads the printed material P using the second terminal 12. When the fifth receiving unit 28 receives the scanned image from the second terminal 12, it receives the scanned image in association with the ID information of the second terminal 12.

[0087] The identification unit 29 analyzes the read image received by the fifth receiving unit 28 and identifies the storage location of the AR content from the portion of the read image in which the second image region Pb is captured (the portion corresponding to the second image).

[0088] The second transmission unit 30 creates display data for the AR content stored in the storage location identified by the identification unit 29 and transmits it to the second terminal 12. At this time, the second terminal 12 displays the scanned image of the printed material P on its screen. Then, when the display data is received by the second terminal 12, the above-mentioned AR content, that is, the AR content set by the first user, is displayed on the display screen in a state where it is superimposed on the scanned image. More specifically, the above-mentioned AR content is displayed on the display screen at a position corresponding to the part of the scanned image that shows the first image region (the part corresponding to the first image). Furthermore, the above AR content is displayed according to the display conditions (settings) indicated by the setting information received by the third receiving unit 25.

[0089] The determination unit 31 determines whether the second user to whom the AR content is provided has paid for the AR content (specifically, the fee for the display data of the AR content). Specifically, the determination unit 31 identifies the ID information of the second terminal 12 associated with the read image received by the fifth receiving unit 28, and refers to the management data corresponding to that ID information. Then, the determination unit 31 determines whether or not the second user using the second terminal 12 has paid the fee.

[0090] If the determination unit 31 determines that the second user has paid the fee, the second transmission unit 30 transmits the AR content display data to the second user's second terminal 12. Conversely, if the second user has not paid the fee, the AR content is not provided to the second user, meaning that the AR content display data is not transmitted to the second user's second terminal 12. Thus, in this embodiment, the AR content can only be displayed to the second terminal 12 of the second user who purchased the target image.

[0091] The restriction setting unit 32 sets restrictions on the provision of AR content to the second user (i.e., the transmission of AR content display data to the second terminal 12). Specifically, the restriction setting unit 32 sets a period during which the AR content can be provided to the second user. The second transmission unit 30 transmits the AR content display data to the second user's second terminal 12 only within the provision period set for the second user.

[0092] Furthermore, the restriction setting unit 32 sets a limit on the number of times AR content can be provided to the second user, that is, the number of times display data for AR content can be transmitted. In addition, the restriction setting unit 32 reduces the number of transmissions allowed for the second user according to the number of times the second transmission unit 30 performs the process of transmitting display data to the second terminal 12. When the number of transmissions allowed for the second user reaches zero, the transmission of display data to the second terminal 12 by that second user is restricted thereafter.

[0093] Furthermore, the number of times AR content can be provided (the number of times display data can be sent) can be any number, for example, only once. In other words, after AR content has been provided to a second user once, the provision of AR content (sending of display data) may be restricted. Furthermore, there are no particular limitations on how AR content can be restricted; it may be prohibited from providing AR content (transmission of display data), or the AR content itself may be deleted from its storage location. In addition, if restrictions are set, a notification may be sent to the second user prompting them to pay to lift the restrictions.

[0094] The update unit 33 updates the AR content provided when a second user reads the same printed material P, provided that predetermined conditions (hereinafter referred to as update conditions) are met. In other words, the target of the update by the update unit 33 is the AR content associated with the same first image and stored in the storage location identified by the second image.

[0095] The updated AR content may, for example, be set by the first user. That is, when the update conditions are met, the first user sets new AR content and display conditions, and the second receiving unit 23 receives and acquires the new AR content, and the third receiving unit 25 receives and acquires the setting information indicating the new display conditions. The update unit 33 saves the new AR content as the updated AR content to the storage location of the pre-update AR content. At this time, the updated AR content is associated with the first image that was associated with the pre-update AR content. Furthermore, it is preferable to notify the second user when the AR content is updated.

[0096] When the second transmission unit 30 transmits the AR content display data to the second terminal 12 after the content has been updated, the updated AR content display data is transmitted. As a result, the updated AR content is displayed on the second terminal 12 at a position on its display screen corresponding to the portion of the first image area in the scanned image that is captured.

[0097] The update conditions are not particularly limited and can be any conditions, but they may be set in association with a second user, for example. Specifically, the update conditions may be the passage of a predetermined period of time since the second user first read printed document P, or the arrival of the second user's birthday.

[0098] The remittance processing unit 34 performs a process (hereinafter referred to as the remittance process) to remit at least a portion of the fee for the AR content paid by the second user to a predetermined recipient. The remittance process is, for example, a process to remit funds to the account of the first user or the operator of the content provision service, and the content and procedures of this process are the same as those of remittance processes in publicly known electronic commerce.

[0099] <Information processing flow for content provision according to one embodiment of the present invention> An information processing flow (hereinafter referred to as the "content provision flow") by a content provision device according to one embodiment of the present invention will be described. The content provision flow employs the content provision method of the present invention. In other words, each step in the content provision flow corresponds to a component of the content provision method of the present invention.

[0100] The content delivery flow proceeds as shown in Figures 8 and 9. Each step in the content delivery flow is executed through the cooperation of the processor 10A of the server computer 10, which constitutes the content delivery device 20, and the first terminal 11 and the second terminal 12, respectively.

[0101] The content delivery flow is initiated, for example, when a second user purchases an image from the first user. In the content delivery flow, first, the first terminal 11 sends the image purchased by the second user, i.e., the target image, to the server computer 10 (S001). The processor 10A of the server computer 10 receives the target image from the first terminal 11 (S012). At this time, the processor 10A also obtains information about the second terminal 12 of the second user who purchased the target image.

[0102] Next, the processor 10A sets at least a portion of the target image as the first image (S003). In S003, the processor 10A may set the first image based on editing operations performed on the target image by the first user on the first terminal 11, or it may set it automatically according to predetermined setting criteria.

[0103] Next, the first terminal 11 sets the AR content to be provided to the second user and displayed on the display screen of the second terminal 12, as well as its display conditions, based on the operation of the first user (S004). Subsequently, the first terminal 11 transmits the set AR content and setting information indicating the set display conditions to the server computer 10 (S005). The processor 10A receives and acquires the AR content and setting information from the first terminal 11 (S006).

[0104] Next, the processor 10A saves the AR content received in S006 in association with the first image set in S003 (S007). At this time, the setting information may also be saved together with the AR content in association with the first image. Also in S007, the processor 10A generates a second image by encoding information indicating the save location of the AR content.

[0105] Next, the first terminal 11 specifies the print conditions for the content acquisition image, including the target image and the second image, based on the operation by the first user (S008). Specifically, in S008, the type (size) of photosensitive film used to print the content acquisition image is specified as a print condition. Subsequently, the first terminal 11 transmits specification information indicating the specified print conditions to the server computer 10 (S009). The processor 10A receives the specification information from the first terminal 11 (S010).

[0106] Next, the processor 10A generates print data for printing the content acquisition image according to the print conditions indicated by the specified information, and transmits the generated data to the second terminal 12 (S011). The print data is received by the second terminal 12 of the second user who purchased the target image (S012).

[0107] Next, the second terminal 12 controls the portable printer 13 according to the print data to print the content acquisition image onto the portable printer 13 (S013). As a result, the content acquisition image is printed onto a photosensitive film of the type (size) specified by the first user, and the second user obtains the printed item P.

[0108] Next, the second terminal 12 uses its reading function to read the printed document P, and the read image is transmitted to the server computer 10 (S014). At this time, the read image is transmitted in association with the ID information of the second terminal 12, which is the source of the transmission. The transmitted read image is received by the processor 10A (S015).

[0109] Next, the processor 10A analyzes the image received in S015 and extracts the portion of the image containing the second image region Pb (the portion corresponding to the second image). Then, from the extracted portion, the processor 10A identifies the storage location of the AR content set by the first user and provided to the second user (S016). The processor 10A also reads the AR content from the identified storage location.

[0110] Next, processor 10A determines whether the second user, who is the recipient of the AR content, has paid for the AR content (the fee for the data used to display the AR content) (S017). If the second user has already paid, the process proceeds to S018; otherwise, the flow ends.

[0111] Next, processor 10A determines whether the remaining number of times display data can be sent to the second user is zero (S018). If the remaining number is not zero, the process proceeds to S019; if the remaining number is zero, the flow ends.

[0112] Next, the processor 10A generates display data for the AR content stored in the storage location identified in S016 and transmits the generated display data to the second terminal 12 (S019). Upon receiving the display data (S020), the second terminal 12 unpacks the display data and displays the AR content on its display screen (S021). At this time, the display screen of the second terminal 12 shows the scanned image (i.e., a real-time image of the printed material P), and the AR content is displayed superimposed on the scanned image. In other words, in S019, display data is transmitted to the second terminal 12 that displays the AR content superimposed on the scanned image displayed on the display screen.

[0113] Furthermore, in S021, the AR content is displayed according to the display conditions indicated by the configuration information received in S006. More specifically, the AR content is displayed on the display screen at a position determined based on the portion of the screen that shows the first image area of ​​the read image (the portion corresponding to the first image). In other words, in S019, display data that displays the AR content according to the display conditions, or more specifically, display data that displays the AR content at a position on the display screen corresponding to the portion of the screen that shows the first image area, is transmitted to the second terminal 12.

[0114] The content provision flow ends when the above series of steps are completed. According to the content provision flow of this embodiment, the AR content provided can be displayed appropriately by printing the content acquisition image obtained via the network and reading the printed document P.

[0115] To explain in more detail, if the type (size) of photosensitive film used to print the image for obtaining the content changes, the size of the printed image will change. In that case, the position of the first image (i.e., the template image) in the printed image will change. Therefore, if the correct type (size) of photosensitive film is not used, the AR content may not be displayed in the correct position. In such a situation, there is a risk that the intention of the first user who set up the content will not be correctly reflected when the AR content is displayed.

[0116] In contrast, in this embodiment, data for printing the content acquisition image onto a type of photosensitive film (specified medium) specified by the first user or first terminal is transmitted to the second terminal 12 as print data. Since this print data cannot be changed (overwritten) by the second terminal 12, the content acquisition image will only be printed on the type of photosensitive film specified by the first user. As a result, the content acquisition image will be properly printed onto the photosensitive film, and the first image will be positioned in the correct location within the content acquisition image. Consequently, when the printed content acquisition image P is read, the AR content will be displayed appropriately on the display screen (more specifically, in the appropriate position on the display screen).

[0117] Furthermore, the above effects are particularly significant when AR content is superimposed onto the scanned image of a printed document P and displayed. In other words, in this embodiment, AR content can be displayed appropriately using the procedure described above, making it easier to popularize the provision of AR content through network printing. As a result, it is possible to revitalize content provision services.

[0118] Furthermore, in this embodiment, restrictions are placed on the provision of AR content (in other words, the transmission of display data for AR content) in terms of timing and frequency. This prevents inappropriate misuse and duplication of AR content, and as a result, ensures the appropriate use and protection of AR content.

[0119] In addition, in this embodiment, the content update flow shown in Figure 10 is performed separately. The content update flow is started when the update conditions are met (S031). When the flow is started, the first user sets new AR content and its display conditions, and the first terminal 11 sends setting information indicating the new AR content and new display conditions to the server computer 10 (S032, S033).

[0120] When processor 10A receives new AR content and configuration information (S034), it updates the AR content stored in association with the first image in S007 to the new AR content (S035). This completes the content update flow.

[0121] Then, in step S019 of the content delivery flow, which is performed after the AR content is updated, the processor 10A transmits display data for the updated AR content. This display data causes the updated AR content to be displayed on the display screen of the second terminal 12 at a position corresponding to the portion of the first image area in the read image that is captured. In this way, by updating the displayable AR content by reading a single printed item P, the interest of the second user, or more specifically, their interest in the provided AR content, can be sustained compared to when only a single piece of AR content is displayed.

[0122] <Other Embodiments> The embodiments described above are specific examples given to clearly illustrate the content provisioning device and content provisioning method of the present invention, and are merely examples; other embodiments are also conceivable.

[0123] In the above embodiment, the print data for the content acquisition image is received by the second terminal 12, but this is not the only possible configuration. For example, the portable printer 13 may receive the print data directly.

[0124] Furthermore, in the above embodiment, from the standpoint of content protection, restrictions were placed on the provision of AR content, specifically setting a provision period and a limit on the number of times it could be provided. However, this is not limited to this, and if the number of second users to whom a certain AR content is provided (specifically, the number of second users who have purchased the same target image) exceeds a predetermined number, the restrictions on that AR content may be lifted.

[0125] Furthermore, in the above embodiment, even if the printed material P is read by the second terminal 12, the AR content will not be displayed unless the fee for the AR content has been paid. However, this is not limited to this, and for example, if a user who has not paid the fee for the AR content (for example, a family member of the second user who has paid the fee) reads the printed material P with a smartphone with a camera, the AR content may be displayed on the display screen.

[0126] Furthermore, in the above embodiment, the functions of the content provision device of the present invention are performed by a processor 10A provided in the server computer 10, but this is not limited to this. The processor provided in the content provision device of the present invention may also be provided in the terminals used by the user (i.e., the first terminal 11 and the second terminal 12), and the portable printer 13. In other words, some or all of the above-mentioned functional units provided in the content provision device of the present invention may be provided in the first terminal 11, the second terminal 12, or the portable printer 13.

[0127] Furthermore, the content provisioning device of the present invention may be the first terminal 11, meaning that the processor provided by the content provisioning device of the present invention may be the processor provided by the first terminal 11. In this case, the processor of the first terminal 11 will perform each step in the content provisioning flow described above. That is, the first terminal 11 may acquire printer information from the second terminal 12, generate print data based on the acquired printer information, and transmit it to the second terminal 12. Alternatively, the first terminal 11 may receive a read image from the second terminal 12, identify the content storage location from the portion of the read image corresponding to the second image, and transmit display data to the second terminal 12 to display the content.

[0128] The content delivery device of the present invention includes various types of processors. These various types of processors include, for example, a CPU, which is a general-purpose processor that executes software (programs) and functions as various processing units. Furthermore, various types of processors include PLDs (Programmable Logic Devices), such as FPGAs (Field Programmable Gate Arrays), which are processors whose circuit configuration can be changed after manufacturing. Furthermore, various types of processors include dedicated electrical circuits, such as ASICs (Application Specific Integrated Circuits), which are processors with circuit configurations specifically designed to perform particular processing.

[0129] Furthermore, one processing unit of the content provisioning device of the present invention may be configured with one of the various processors described above, or with a combination of two or more processors of the same or different types, for example, a combination of multiple FPGAs, or a combination of FPGA and CPU. Furthermore, the multiple functional units of the content provisioning device of the present invention may be configured by one of various processors, or two or more of the multiple functional units may be combined and configured by a single processor. Furthermore, as in the embodiment described above, a single processor may be configured by a combination of one or more CPUs and software, and this processor may function as multiple functional units.

[0130] Furthermore, the present invention may utilize a processor that implements the functions of the entire system, including multiple functional units, on a single IC (Integrated Circuit) chip, such as a SoC (System on Chip). Additionally, the hardware configuration of the various processors described above may be an electrical circuit (Circuitry) combining circuit elements such as semiconductor devices. [Explanation of Symbols]

[0131] 10 server computers 10A Processor 10B memory 10C communication interface 11. Terminal 1 12 Second Terminal 13. Portable printer 14 Storage device 20 Content provision device 21 First Receiving Unit 22 Setting section 23 Second Receiving Unit 24 Preservation Department 25 Third Receiving Unit 26. Fourth receiving unit 27 First Transmitter 28. Fifth Receiving Unit 29 Specific section 30 Second Transmitter 31 Judgment section 32 Restriction setting section 33 Update section 34 Remittance Processing Unit A1, A2, A3, A4 Content N External Network P Printed items Pa Target image area Pb Second Image Region S Content Delivery System

Claims

1. A content delivery device equipped with a processor, The aforementioned processor, A process for associating a first image provided by the first user with content displayed on the second user's terminal screen, A process of sending print data to the terminal for printing the first image and the second image relating to the content onto a specified medium specified by the first user, When a printout generated by printing the first image onto the designated medium according to the print data is read by the terminal, the process of receiving the read image of the printout from the terminal, The process of displaying the content at a position corresponding to the portion of the read image that corresponds to the first image in the display screen, A content delivery device that performs this task.

2. Printer information relating to the printer used by the second user when printing an image is stored in the terminal, or is stored in the server computer in association with the second user's ID information. The aforementioned processor, The printer information is obtained from the terminal or the server computer. The content providing device according to claim 1, which sets print conditions for causing the second user to print the first image based on the printer information, and which include the specified medium.

3. The content providing device according to claim 1, wherein the processor, in the process of displaying the content on the display screen, displays the content in a state in which the content has been combined with the read image displayed on the display screen.

4. The processor executes a process to obtain configuration information indicating the settings related to the display of the content. The content providing device according to any one of claims 1 to 3, wherein the processor displays the content according to the settings.

5. Whether or not payment has been made for the aforementioned content is stored in the storage device. The content providing device according to any one of claims 1 to 4, wherein the processor causes the content to be displayed on the display screen of the terminal of the second user who has paid the fee.

6. The content provision device according to claim 5, wherein the processor performs processing to transfer at least a portion of the fee paid by the second user to a predetermined recipient.

7. The aforementioned processor, The process of updating the content associated with the first image is performed. The content providing device according to any one of claims 1 to 6, wherein, in the process of displaying the content on the display screen after updating the content, the updated content is displayed in the position.

8. The process involves associating a first image provided by the first user with content displayed on the screen of the second user's device. The process includes transmitting print data to the terminal for printing the first image and the second image relating to the content onto a specified medium designated by the first user, When a printed material is generated by printing the first image onto the designated medium according to the print data, and that printed material is read by the terminal, the process includes receiving a read image, which is an image of the read printed material, from the terminal. The steps include: displaying the content at a position on the display screen corresponding to the portion of the read image that corresponds to the first image; A content delivery method that is implemented by a processor.

9. Printer information relating to the printer used by the second user when printing an image is stored in the terminal, or is stored in the server computer in association with the second user's ID information. A step of obtaining the printer information from the terminal or the server computer, The content provision method according to claim 8, wherein the processor performs the steps of setting print conditions, which include the specified medium, for printing the first image and the second image on the second user side based on the printer information.

10. The content provision method according to claim 8 or 9, wherein, in the step of displaying the content on the display screen, the processor displays the content in a state in which the content has been combined with the read image displayed on the display screen.

11. The processor performs the step of obtaining setting information that indicates the settings for displaying the aforementioned content. The content provision method according to any one of claims 8 to 10, wherein in the step of displaying the content on the display screen, the processor displays the content according to the settings.

12. The processor performs the step of updating the content associated with the first image. The content provision method according to any one of claims 9 to 11, wherein, in the step of displaying the content on the display screen after updating the content, the processor displays the updated content in the position.

13. A program for causing a computer to perform each step included in the content provision method described in any one of claims 8 to 12.

14. A computer-readable recording medium, A recording medium on which a program is recorded causing a computer to execute each step included in the content provision method according to any one of claims 8 to 12.

Citation Information

Patent Citations

  • Content managing system, management content generating method, management content reproducing method, program, and recording medium

    JP2016058024A

  • Print system

    JP2019192016A