Real-time data processing device

Abstract

In the real-time data processing device (1), when camera images are input as raster-form image data and handwritten inputs are input as vector-form drawing data, raster-form flipped image data and vector-form flipped drawing data are generated. Not only is the vector-form drawing data displayed in the drawing area (A1) of the touch panel unit, but also the raster-form flipped image data and the vector-form flipped drawing data are superimposed and displayed in the preview area (A2). The vector-form drawing data is encoded to generate raster-form drawing data, and the raster-form image data and the raster-form drawing data are rendered to generate composite data for storage.

Description

Technical Field

[0001] The present invention relates to a real-time data processing device having a real-time preview function capable of superimposing and displaying image data (built-in camera image) and drawing data (handwritten input). Background Art

[0002] In the prior art, a method of superimposing and displaying a camera image and a handwritten input has been proposed (for example, refer to Patent Document 1). In the existing method, in the live stream method of live broadcasting via the network, image data (synthetic image data) obtained by overlapping the drawing drawn by the broadcaster on the image data from the camera is generated.

[0003] In the existing method, the data format is not limited, but generally, in the case of synthesizing two pieces of data, the same data format is used. As the data format of the image data from the camera, a raster format is generally used. Therefore, in the existing method, as the data format of the drawing data drawn by the broadcaster, a raster format is generally considered. In the existing method, even for the purpose of achieving a low-cost and highly expressive broadcast, there is no significance in using different data formats. In addition, even for efficiently generating synthetic image data for output to the network for the viewer, in the existing method, a raster format identical to the image data is considered as the data format of the drawing data.

[0004] However, in the existing method, a technique for real-time preview of synthetic image data has not been proposed, nor has a technique for reducing the processing burden for real-time preview been proposed. In the case of performing real-time preview of synthetic image data, if the drawing data is to be displayed and processed in raster format, the processing is heavy, so there is a situation where it is difficult to perform real-time processing with a device having a relatively low processing power (for example, a tablet device having a lower processing power than a PC). To enable a device with low processing power to perform real-time processing, it is necessary to reduce the resolution of the data, but in this case, the resolution of the data output to the network for the viewer will be insufficient.

[0005] Prior Art Documents

[0006] Patent Documents

[0007] Patent Document 1: JP-A-2005-51703 (paragraphs 0203 - 0210, FIGS. 12 - 13) Summary of the Invention

[0008] (Problems to be Solved by the Invention)

[0009] The present invention has been made in view of the above background. An object of the present invention is to provide a real-time data processing device capable of generating high-resolution synthetic data while reducing the processing burden for real-time preview.

[0010] (Technical solution for solving the problem)

[0011] One aspect of the present invention provides a real-time data processing device, comprising: a built-in camera unit that captures an image of the user himself / herself using the device; a touch panel unit that can display the image captured by the built-in camera unit to the user and can accept the user's handwritten input; and a microphone unit that inputs the user's voice. A drawing area and a preview area are provided on the touch panel unit. The drawing area is an area for accepting handwritten input, and the preview area is an area for displaying the image captured by the built-in camera unit. The real-time data processing device comprises: an image data input unit that inputs the image captured by the built-in camera unit as raster-form image data; an image flipping processing unit that flips the raster-form image data input from the image data input unit to generate raster-form flipped image data; a drawing data input unit that inputs the handwritten input input from the touch panel unit as vector-form drawing data; a drawing flipping processing unit that flips the vector-form drawing data input from the drawing data input unit to generate vector-form flipped drawing data; a sound data input unit that inputs the user's voice input from the microphone unit as sound data; a real-time preview processing unit that displays the vector-form drawing data input from the drawing data input unit in the drawing area of the touch panel unit, superimposes and displays the raster-form flipped image data generated by the image flipping processing unit and the vector-form flipped drawing data generated by the drawing flipping processing unit in the preview area of the touch panel unit, and outputs the sound data input from the sound data input unit; an encoding processing unit that performs encoding processing on the vector-form drawing data input from the drawing data input unit to generate raster-form drawing data; and a rendering processing unit that performs rendering processing on the raster-form image data input from the image data input unit, the raster-form drawing data generated by the encoding processing unit, and the sound data input from the sound data input unit to generate composite data for storage.

[0012] Another aspect of the present invention provides a method executed by a real-time data processing device, the real-time data processing device including: a built-in camera unit that captures an image of the user himself / herself using the device; a touch panel unit that can display the image captured by the built-in camera unit to the user and can accept the user's handwritten input; and a microphone unit that inputs the user's voice. A drawing area and a preview area are provided on the touch panel unit. The drawing area is an area for accepting handwritten input, and the preview area is an area for displaying the image captured by the built-in camera unit. The method includes: an image data input step of inputting the image captured by the built-in camera unit as raster-form image data; a drawing data input step of inputting the handwritten input received from the touch panel unit as vector-form drawing data; a voice data input step of inputting the user's voice received from the microphone unit as voice data; an image flipping process step of flipping the raster-form image data input in the image data input step to generate raster-form flipped image data; a drawing flipping process step of flipping the vector-form drawing data input in the drawing data input step to generate vector-form flipped drawing data; a real-time preview process step of displaying the vector-form drawing data input in the drawing data input step on the drawing area of the touch panel unit, and superimposing and displaying the raster-form flipped image data generated in the image flipping process step and the vector-form flipped drawing data generated in the drawing flipping process step on the preview area of the touch panel unit, and outputting the voice data input in the voice data input step; an encoding process step of performing encoding processing on the vector-form drawing data input in the drawing data input step to generate raster-form drawing data; and a rendering process step of performing rendering processing on the raster-form image data input in the image data input step, the raster-form drawing data generated in the encoding process step, and the voice data input in the voice data input step to generate composite data for storage.

[0013] Another aspect of the present invention provides a program executed by a real-time data processing device, the real-time data processing device comprising: a built-in camera unit that captures an image of the user himself / herself using the device; a touch panel unit that can display the image captured by the built-in camera unit to the user and can accept the user's handwritten input; and a microphone unit that inputs the user's voice. A drawing area and a preview area are provided on the touch panel unit. The drawing area is an area for accepting handwritten input, and the preview area is an area for displaying the image captured by the built-in camera unit. The program causes the real-time data processing device to perform the following processes: an image data input process of inputting the image captured by the built-in camera unit as raster-form image data; a drawing data input process of inputting the handwritten input received from the touch panel unit as vector-form drawing data; a voice data input process of inputting the user's voice received from the microphone unit as voice data; an image flipping process of flipping the raster-form image data input in the image data input process to generate raster-form flipped image data; a drawing flipping process of flipping the vector-form drawing data input in the drawing data input process to generate vector-form flipped drawing data; a real-time preview process of displaying the vector-form drawing data input in the drawing data input process on the drawing area of the touch panel unit, superimposing and displaying the raster-form flipped image data generated in the image flipping process and the vector-form flipped drawing data generated in the drawing flipping process on the preview area of the touch panel unit, and outputting the voice data input in the voice data input process; an encoding process of performing an encoding process on the vector-form drawing data input in the drawing data input process to generate raster-form drawing data; and a rendering process of performing a rendering process on the raster-form image data input in the image data input process, the raster-form drawing data generated in the encoding process, and the voice data input in the voice data input process to generate composite data for storage.

[0014] As described below, the present invention has other aspects. Therefore, the disclosure of the present invention aims to provide some aspects of the present invention and is not intended to limit the scope of the invention described and claimed herein. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 is a block diagram of a real-time data processing device in an embodiment of the present invention.

[0016] Figure 2 is an explanatory diagram of a process executed by the real-time data processing device.

[0017] Figure 3 is a diagram showing a display example of the real-time preview process.

[0018] Figure 4It is a flowchart showing the process of the processing executed by the real-time data processing device. Detailed Embodiment

[0019] The following describes the detailed description of the present invention. However, the following detailed description and the drawings do not limit the invention.

[0020] The real-time data processing device of the present invention includes: a built-in camera unit that captures an image of the user himself / herself using the device; a touch panel unit that can display the image captured by the built-in camera unit to the user and can accept the user's handwritten input; and a microphone unit that inputs the user's voice. A drawing area and a preview area are provided on the touch panel unit. The drawing area is an area for accepting handwritten input, and the preview area is an area for displaying the image captured by the built-in camera unit. The real-time data processing device includes: an image data input unit that inputs the image captured by the built-in camera unit as raster-form image data; an image flipping processing unit that flips the raster-form image data input from the image data input unit to generate raster-form flipped image data; a drawing data input unit that inputs the handwritten input from the touch panel unit as vector-form drawing data; a drawing flipping processing unit that flips the vector-form drawing data input from the drawing data input unit to generate vector-form flipped drawing data; a sound data input unit that inputs the user's voice input from the microphone unit as sound data; a real-time preview processing unit that displays the vector-form drawing data input from the drawing data input unit in the drawing area of the touch panel unit, superimposes and displays the raster-form flipped image data generated by the image flipping processing unit and the vector-form flipped drawing data generated by the drawing flipping processing unit in the preview area of the touch panel unit, and outputs the sound data input from the sound data input unit; an encoding processing unit that performs encoding processing on the vector-form drawing data input from the drawing data input unit to generate raster-form drawing data; and a rendering processing unit that performs rendering processing on the raster-form image data input from the image data input unit, the raster-form drawing data generated by the encoding processing unit, and the sound data input from the sound data input unit to generate composite data for storage.

[0021] According to this configuration, in the real-time preview, superimposed display using the raster-form flipped image data and the vector-form flipped drawing data is performed in the preview area of the touch panel unit. Since vector-form data is used for the display purpose of handwritten input, the burden of display processing can be reduced compared with the case of using raster form. Therefore, although in the past, in the case of using raster form, processing such as reducing the resolution was required to reduce the processing burden, the present invention makes such processing unnecessary.

[0022] In addition, since the drawing data is flipped (using the flipped drawing data) corresponding to the image data (flipped image data) displayed in the preview area, it is possible to suppress the user from feeling a sense of mismatch with the display in the preview area.

[0023] Furthermore, at this time, in the drawing area of the touch panel unit, the display using the drawing data in vector form (unflipped drawing data) is performed, so that the user can easily confirm his / her handwritten input without feeling discomfort.

[0024] Moreover, the raster-form drawing data generated from the vector-form drawing data is used to generate the composite data for storage. Thereby, not only can the processing burden of the real-time preview be reduced, but also the composite data with high resolution can be generated.

[0025] In addition, in the real-time data processing device of the present invention, the real-time preview processing unit can arrange the raster-form flipped image data generated by the image flipping processing unit in the lower layer, and arrange the vector-form flipped drawing data generated by the drawing flipping processing unit in the upper layer, so as to perform the superimposed display in the preview area.

[0026] According to this configuration, in the superimposed display in the preview area, the raster-form flipped image data is arranged in the lower layer, and the vector-form flipped drawing data is arranged in the upper layer. By performing such a superimposed display using multiple layers, the processing burden of the superimposed display in the preview area can be reduced.

[0027] The method of the present invention is a method executed by a real-time data processing device, which includes: a built-in camera unit that captures an image of the user himself / herself using the device; a touch panel unit that can display the image captured by the built-in camera unit to the user and can accept the user's handwritten input; and a microphone unit that inputs the user's voice. A drawing area and a preview area are provided on the touch panel unit. The drawing area is an area for accepting handwritten input, and the preview area is an area for displaying the image captured by the built-in camera unit. The method includes: an image data input step of inputting the image captured by the built-in camera unit as raster-form image data; a drawing data input step of inputting the handwritten input received from the touch panel unit as vector-form drawing data; a voice data input step of inputting the user's voice received from the microphone unit as voice data; an image flipping process step of flipping the raster-form image data input in the image data input step to generate raster-form flipped image data; a drawing flipping process step of flipping the vector-form drawing data input in the drawing data input step to generate vector-form flipped drawing data; a real-time preview process step of displaying the vector-form drawing data input in the drawing data input step on the drawing area of the touch panel unit, and superimposing and displaying the raster-form flipped image data generated in the image flipping process step and the vector-form flipped drawing data generated in the drawing flipping process step on the preview area of the touch panel unit, and outputting the voice data input in the voice data input step; an encoding process step of performing encoding processing on the vector-form drawing data input in the drawing data input step to generate raster-form drawing data; and a rendering process step of performing rendering processing on the raster-form image data input in the image data input step, the raster-form drawing data generated in the encoding process step, and the voice data input in the voice data input step to generate composite data for storage.

[0028] According to this method, as described above, in the real-time preview, superimposed display using the raster-form flipped image data and the vector-form flipped drawing data is performed in the preview area of the touch panel unit. Since vector-form data is used for the display purpose of handwritten input, the burden of display processing can be reduced compared with the case of using raster form. Therefore, although in the past, in the case of using raster form, processing such as reducing the resolution was required to reduce the processing burden, the present invention makes such processing unnecessary.

[0029] In addition, since the drawing data is flipped (using the flipped drawing data) corresponding to the image data (flipped image data) displayed in the preview area, a sense of mismatch felt by the user with respect to the display in the preview area can be suppressed.

[0030] Furthermore, at this time, display using drawing data in vector form (non-flipped drawing data) is performed in the drawing area of the touch panel unit, so that the user can easily confirm his / her handwritten input without feeling discomfort.

[0031] In addition, raster-form drawing data generated from the vector-form drawing data is used to generate composite data for storage. Thereby, not only can the processing burden of real-time preview be reduced, but also high-resolution composite data can be generated.

[0032] The program of the present invention is a program executed by a real-time data processing device, the real-time data processing device including: a built-in camera unit that captures an image of the user himself / herself using the device; a touch panel unit that can display the image captured by the built-in camera unit to the user and can accept the user's handwritten input; and a microphone unit that inputs the user's voice. A drawing area and a preview area are provided in the touch panel unit. The drawing area is an area for accepting handwritten input, and the preview area is an area for displaying the image captured by the built-in camera unit. This program causes the real-time data processing device to perform the following processes: an image data input process of inputting the image captured by the built-in camera unit as raster-form image data; a drawing data input process of inputting the handwritten input from the touch panel unit as vector-form drawing data; a voice data input process of inputting the user's voice from the microphone unit as voice data; an image flipping process of flipping the raster-form image data input in the image data input process to generate raster-form flipped image data; a drawing flipping process of flipping the vector-form drawing data input in the drawing data input process to generate vector-form flipped drawing data; a real-time preview process of displaying the vector-form drawing data input in the drawing data input process in the drawing area of the touch panel unit, and superimposing and displaying the raster-form flipped image data generated in the image flipping process and the vector-form flipped drawing data generated in the drawing flipping process in the preview area of the touch panel unit, and outputting the voice data input in the voice data input process; an encoding process of performing encoding processing on the vector-form drawing data input in the drawing data input process to generate raster-form drawing data; and a rendering process of performing rendering processing on the raster-form image data input in the image data input process, the raster-form drawing data generated in the encoding process, and the voice data input in the voice data input process to generate composite data for storage.

[0033] According to this program, as described above, in real-time preview, in the preview area of the touch panel unit, superimposed display of raster-form flipped image data and vector-form flipped drawing data is performed. Since vector-form data is used for the display purpose of handwritten input, the burden of display processing can be reduced compared with the case of using raster form. Therefore, although in the past, in the case of using raster form, processing such as reducing the resolution was required to reduce the processing burden, the present invention makes such processing unnecessary.

[0034] In addition, since the drawing data is flipped (using flipped drawing data) corresponding to the image data (flipped image data) displayed in the preview area, it is possible to suppress the user from feeling a sense of mismatch in the display of the preview area.

[0035] Furthermore, at this time, display using vector-form drawing data (unflipped drawing data) is performed in the drawing area of the touch panel unit, so that the user can easily confirm his / her handwritten input without feeling discomfort.

[0036] Moreover, raster-form drawing data generated from vector-form drawing data is used to generate composite data for saving. Thereby, not only can the processing burden of real-time preview be reduced, but also high-resolution composite data can be generated.

[0037] According to the present invention, not only can the processing burden of real-time preview be reduced, but also high-resolution composite data can be generated.

[0038] (Embodiment)

[0039] Hereinafter, the real-time data processing apparatus according to the embodiment of the present invention will be described with reference to the drawings. In the present embodiment, an example of a real-time data processing apparatus (for example, a tablet device, etc.) used in a service that provides an application for real-time synthesis of a camera image and a drawing (for example, a service that provides an application that can perform real-time preview of the synthesis of a camera image and handwriting of an athlete, a celebrity, etc. and a fan and can be animated) will be illustrated.

[0040] The configuration of the real-time data processing apparatus according to the embodiment of the present invention will be described with reference to the drawings. Figure 1 It is a block diagram showing the configuration of the real-time data processing apparatus according to the present embodiment. As Figure 1 shown, the real-time data processing apparatus 1 includes: a built-in camera unit 2, a touch panel unit 3, a microphone unit 4, a storage unit 5, and a data processing unit 6.

[0041] The built-in camera unit 2 is constituted by, for example, an embedded camera or the like. The built-in camera unit 2 is disposed above the touch panel unit 3 of the real-time data processing apparatus 1 and has a function of photographing an image of the user himself / herself who is using the real-time data processing apparatus 1. The built-in camera unit 2 may also be constituted by an external type camera.

[0042] The touch panel unit 3 is constituted by, for example, a touch panel display or the like. The touch panel unit 3 has a function of displaying an image captured by the built-in camera unit 2 to the user, and a function of accepting a handwritten input from the user. The touch panel unit 3 can be said to have the functions of both a so-called display unit and an input unit. When the real-time data processing device 1 is set to the real-time preview mode, a drawing area A1 which is an area for accepting a handwritten input and a preview area A2 which is an area for displaying an image captured by the built-in camera unit 2 are provided in the touch panel unit 3 (refer to Figure 3 ).

[0043] The microphone unit 4 is constituted by, for example, a device-integrated microphone or the like. Sounds of the user using the real-time data processing device 1, etc. are input from the microphone unit 4 (voice input).

[0044] The storage unit 5 is constituted by, for example, an HDD, a memory, or the like. Various data can be stored in the storage unit 5. In addition, a program for causing the real-time data processing device 1 to execute various processes is stored in the storage unit 5. By executing the program stored in the storage unit 5, the real-time preview process described below is executed.

[0045] The data processing unit 6 is constituted by, for example, a CPU, an MPU, or the like, and has a function of performing various data processes. More specifically, the data processing unit 6 includes an image data input unit 60, a drawing data input unit 61, a sound data input unit 62, an image flipping processing unit 63, a drawing flipping processing unit 64, a real-time preview processing unit 65, an encoding processing unit 66, and a rendering processing unit 67 as functional modules.

[0046] An image captured by the built-in camera unit 2 is input to the image data input unit 60 as raster-form image data. The image flipping processing unit 63 has a function of flipping the raster-form image data input from the image data input unit 60 to generate raster-form flipped image data. A handwritten input input from the touch panel unit 3 is input to the drawing data input unit 61 as vector-form drawing data. The drawing flipping processing unit 64 has a function of flipping the vector-form drawing data input from the drawing data input unit 61 to generate vector-form flipped drawing data. Sounds of the user input from the microphone unit 4 are input to the sound data input unit 62 as sound data.

[0047] When the real-time data processing device 1 is set to the real-time preview mode, the real-time preview processing unit 65 has the following functions: not only displaying (frontally displaying) the vector-form drawing data input from the drawing data input unit 61 in the drawing area A1 of the touch panel unit 3, but also superimposing and displaying the raster-form flipped image data generated by the image flipping processing unit 63 and the vector-form flipped drawing data generated by the drawing flipping processing unit 64 in the preview area A2 of the touch panel unit 3, and outputting the sound data input from the sound data input unit 62.

[0048] When the real-time data processing device 1 is set to the real-time preview mode, the real-time preview processing unit 65 arranges the raster-form flipped image data generated by the image flipping processing unit 63 in the lower layer, and arranges the vector-form flipped drawing data generated by the drawing flipping processing unit 64 in the upper layer, so as to perform the superimposed display in the preview area A2.

[0049] The encoding processing unit 66 has the function of encoding the vector-form drawing data input from the drawing data input unit 61 to generate raster-form drawing data. The rendering processing unit 67 has the function of rendering the raster-form image data input from the image data input unit 60, the raster-form drawing data generated by the encoding processing unit 66, and the sound data input from the sound data input unit 62 to generate the composite data for storage. The composite data generated by the rendering process is stored in the storage unit 5.

[0050] Regarding the real-time data processing device 1 configured as above, its operation will be described with reference to the accompanying drawings. Figure 2 It is an explanatory diagram of the process executed by the real-time data processing device 1. Figure 3 It is a diagram showing a display example of the real-time preview process. Figure 4 It is a flowchart showing the process flow executed by the real-time data processing device 1.

[0051] As Figure 2 and Figure 4 shown, in the real-time data processing device 1 of the present embodiment, not only the image captured by the built-in camera unit 2 is input as raster-form image data (S1), but also the handwritten input from the touch panel unit 3 is input as vector-form drawing data (S2). Furthermore, the user's voice input from the microphone unit 4 is input as sound data (S3).

[0052] Next, the raster-form image data input in the above step S1 is flipped to generate raster-form flipped image data (S4). In addition, the vector-form drawing data input in the above step S2 is flipped to generate vector-form flipped drawing data (S5).

[0053] Moreover, as Figure 3 shown, the raster-form flipped image data (flipped camera image VR) generated in the above step S4 and the vector-form flipped drawing data (flipped handwritten input WR) generated in the above step S5 are superimposed and displayed in the preview area A2 of the touch panel unit 3 (S6), and the vector-form drawing data (unflipped handwritten input W) input in the above step S2 is displayed in the drawing area A1 of the touch panel unit 3 (S7), and moreover, the sound data input in the above step S3 is output (S8).

[0054] In the above step S6, when performing the superimposed display in the preview area A2, the raster-form flipped image data (flipped camera image VR) generated in the above step S4 is arranged in the lower layer, and the vector-form flipped drawing data (flipped handwritten input WR) generated in the above step S5 is arranged in the upper layer.

[0055] Next, the vector-form drawing data input in the above step S2 is encoded to generate raster-form drawing data (S9). Moreover, the raster-form image data input in the above step S1, the raster-form drawing data generated in the above step S9, and the sound data input in the above step S3 are rendered to generate composite data for storage (S10), and the generated composite data is stored in the storage unit 5 (S11).

[0056] According to the real-time data processing device 1 of this embodiment, in real-time preview, a superimposed display using the raster-form flipped image data (flipped camera image VR) and the vector-form flipped drawing data (flipped handwritten input WR) is performed in the preview area A2 of the touch panel unit 3. Since vector-form data is used for the display purpose of handwritten input, the burden of display processing can be reduced compared with the case of using raster form. Therefore, although in the past, in the case of using raster form, processing such as reducing the resolution was required to reduce the processing burden, the present invention makes such processing unnecessary.

[0057] In addition, since the drawing data is flipped corresponding to the image data (flipped image data (flipped camera image VR)) displayed in the preview area A2 (using the flipped drawing data (flipped handwritten input WR)), it is possible to suppress the user from feeling a sense of mismatch with the display in the preview area A2.

[0058] Furthermore, at this time, a display using the vector-form drawing data (unflipped drawing data W) is performed in the drawing area A1 of the touch panel unit 3, so that the user can easily confirm his / her handwritten input without feeling discomfort.

[0059] Moreover, rasterized rendering data generated from vectorized rendering data is used to generate composite data for storage. As a result, not only can the processing burden of real-time preview be reduced, but also high-resolution composite data can be generated.

[0060] In addition, in the present embodiment, in the overlay display in the preview area A2, the rasterized flipped image data (the flipped camera image VR) is arranged in the lower layer, and the vectorized flipped rendering data (the flipped handwritten input WR) is arranged in the upper layer. By performing such an overlay display using multiple layers, the processing burden of the overlay display in the preview area A2 can be reduced.

[0061] The embodiments of the present invention have been described above by way of illustration, but the scope of the present invention is not limited thereto, and it can be changed or modified according to the purpose within the scope described in the claims.

[0062] (Industrial Applicability)

[0063] As described above, the real-time data processing device of the present invention has the effect of being able to generate high-resolution composite data while reducing the processing burden of real-time preview, and is used in services that provide applications for real-time synthesis of camera images and renderings, etc., and has practicality.

[0064] (Reference Signs)

[0065] 1 Real-time data processing device

[0066] 2 Built-in camera unit

[0067] 3 Touch panel unit

[0068] 4 Microphone unit

[0069] 5 Storage unit

[0070] 6 Data processing unit

[0071] 60 Image data input unit

[0072] 61 Rendering data input unit

[0073] 62 Sound data input unit

[0074] 63 Image flipping processing unit

[0075] 64 Rendering flipping processing unit

[0076] 65 Real-time preview processing unit

[0077] 66 Encoding processing unit

[0078] 67 Rendering processing unit

[0079] A1 Drawing area

[0080] A2 Preview area.

Claims

1. A real-time data processing device, comprising: a built-in camera unit that captures an image of the user himself / herself using the device; a touch panel unit that can display the image captured by the built-in camera unit to the user and can accept the user's handwritten input; and a microphone unit that inputs the user's voice. The real-time data processing device is characterized in that a drawing area and a preview area are provided on the touch panel unit, the drawing area is an area for accepting the handwritten input, and the preview area is an area for displaying the image captured by the built-in camera unit. The real-time data processing device further comprises: an image data input unit that inputs the image captured by the built-in camera unit as raster-form image data; an image flipping processing unit that flips the raster-form image data input from the image data input unit to generate raster-form flipped image data; a drawing data input unit that inputs the handwritten input input from the touch panel unit as vector-form drawing data; a drawing flipping processing unit that flips the vector-form drawing data input from the drawing data input unit to generate vector-form flipped drawing data; a voice data input unit that inputs the user's voice input from the microphone unit as voice data; a real-time preview processing unit that displays the vector-form drawing data input from the drawing data input unit in the drawing area of the touch panel unit, superimposes and displays the raster-form flipped image data generated by the image flipping processing unit and the vector-form flipped drawing data generated by the drawing flipping processing unit in the preview area of the touch panel unit, and outputs the voice data input from the voice data input unit; a coding processing unit that performs coding processing on the vector-form drawing data input from the drawing data input unit to generate raster-form drawing data; and a rendering processing unit that performs rendering processing on the raster-form image data input from the image data input unit, the raster-form drawing data generated by the coding processing unit, and the voice data input from the voice data input unit to generate composite data for storage.

2. The real-time data processing device according to claim 1, wherein the real-time preview processing unit arranges the raster-form flipped image data generated by the image flipping processing unit in a lower layer and arranges the vector-form flipped drawing data generated by the drawing flipping processing unit in an upper layer, thereby performing the superimposed display in the preview area.

3. A method executed by a real-time data processing device, the real-time data processing device comprising: a built-in camera unit that captures an image of the user himself / herself using the device; a touch panel unit that can display the image captured by the built-in camera unit to the user and can accept the user's handwritten input; and a microphone unit that inputs the user's voice. The method executed by the real-time data processing device is characterized in that A drawing area and a preview area are provided in the touch panel unit. The drawing area is an area for accepting the handwriting input, and the preview area is an area for displaying an image captured by the built-in camera unit. The method executed by the real-time data processing device includes: An image data input step of inputting the image captured by the built-in camera unit as raster-form image data; A drawing data input step of inputting the handwriting input received from the touch panel unit as vector-form drawing data; A sound data input step of inputting the sound of the user received from the microphone unit as sound data; An image flipping process step of flipping the raster-form image data input in the image data input step to generate raster-form flipped image data; A drawing flipping process step of flipping the vector-form drawing data input in the drawing data input step to generate vector-form flipped drawing data; A real-time preview process step of displaying the vector-form drawing data input in the drawing data input step in the drawing area of the touch panel unit, superimposing and displaying the raster-form flipped image data generated in the image flipping process step and the vector-form flipped drawing data generated in the drawing flipping process step in the preview area of the touch panel unit, and outputting the sound data input in the sound data input step; An encoding process step of performing encoding processing on the vector-form drawing data input in the drawing data input step to generate raster-form drawing data; and A rendering process step of performing rendering processing on the raster-form image data input in the image data input step, the raster-form drawing data generated in the encoding process step, and the sound data input in the sound data input step to generate composite data for storage.

4. A computer program product is executed by a real-time data processing device. The real-time data processing device includes: a built-in camera unit that captures an image of the user himself / herself using the device; a touch panel unit that can display the image captured by the built-in camera unit to the user and can accept the user's handwriting input; and a microphone unit that inputs the sound of the user. The computer program product is characterized in that a drawing area and a preview area are provided in the touch panel unit. The drawing area is an area for accepting the handwriting input, and the preview area is an area for displaying an image captured by the built-in camera unit. The computer program product causes the real-time data processing device to execute the following processing: An image data input process of inputting the image captured by the built-in camera unit as raster-form image data; A drawing data input process of inputting the handwriting input received from the touch panel unit as vector-form drawing data; A sound data input process of inputting the sound of the user received from the microphone unit as sound data; Image flipping process, which flips the raster-form image data input in the image data input process to generate flipped raster-form image data; Drawing flipping process, which flips the vector-form drawing data input in the drawing data input process to generate flipped vector-form drawing data; Real-time preview process, which displays the vector-form drawing data input in the drawing data input process on the drawing area of the touch panel unit, superimposes and displays the flipped raster-form image data generated in the image flipping process and the flipped vector-form drawing data generated in the drawing flipping process on the preview area of the touch panel unit, and outputs the sound data input in the sound data input process; Encoding process, which encodes the vector-form drawing data input in the drawing data input process to generate raster-form drawing data; And Rendering process, which performs rendering processing on the raster-form image data input in the image data input process, the raster-form drawing data generated in the encoding process, and the sound data input in the sound data input process to generate composite data for storage.

Images