Stereoscopic image generating device and method of operating the same

Abstract

A method of operating a stereoscopic image generating device communicating with a rendering server device according to one embodiment of the present disclosure comprises: a step of acquiring first tracking data by tracking a user's motion during a reference time interval; a step of acquiring second tracking data by tracking a user's viewpoint during a reference time interval; a step of providing the first tracking data to a rendering server device; a step of receiving one or more focus image data corresponding to the first tracking data from the rendering server device; a step of extracting one or more regions corresponding to the tracked viewpoint from each of the one or more focus image data based on the second tracking data; a step of generating multi-focus VR (Virtual Reality) image data by up-scaling the extracted one or more regions; and a step of visually providing the multi-focus VR image data to a user by means of a display device of the stereoscopic image generating device.

Description

Technology Field

[0001] The present disclosure relates to a stereoscopic image generating device, and more specifically, to a stereoscopic image generating device and a method of operating the same. Background Technology

[0002] Multifocal stereoscopic video allows viewers to experience a greater sense of spatial depth and immersion compared to single-focal stereoscopic video. However, generating multifocal stereoscopic video requires stereoscopic images for one or more focal lengths. Receiving stereoscopic images for one or more focal lengths from an external server takes more time and requires a wider communication bandwidth. Furthermore, if stereoscopic images corresponding to the user's viewpoint are received from an external server in real time as the user's viewpoint changes, the time required to receive the images from the external server increases even further.

[0003] Therefore, a device is required to generate stereoscopic images that reliably provide the user with a higher sense of spatiality and immersion by directly extracting an image corresponding to the user's viewpoint from an image received from an external server, thereby reducing the time required to receive stereoscopic images for one or more focal lengths and the necessary communication bandwidth. The problem to be solved

[0004] According to one embodiment of the present disclosure, a stereoscopic image generating device and a method of operating the same are provided. means of solving the problem

[0005] According to one embodiment of the present disclosure, a stereoscopic image generating device communicates with a rendering server device. A method of operating the stereoscopic image generating device comprises the steps of: acquiring first tracking data by tracking a user's motion during a reference time interval; acquiring second tracking data by tracking the user's viewpoint during the reference time interval; providing the first tracking data to the rendering server device; receiving one or more focal image data corresponding to the first tracking data from the rendering server device; extracting one or more regions corresponding to the tracked viewpoint from each of the one or more focal image data based on the second tracking data; generating multi-focal VR (Virtual Reality) image data by up-scaling the extracted one or more regions; and visually providing the multi-focal VR image data to the user by means of a display device of the stereoscopic image generating device.

[0006] In some embodiments, the display device includes a binocular display device and a variable focus optical system, and the step of visually providing the multifocal VR image data to the user by the display device of the stereoscopic image generating device includes the step of playing the multifocal VR image data by the binocular display, and the step of synchronizing the time point at which the multifocal VR image data is incident on the user's eye by the variable focus optical system with the time point at which the multifocal VR image data is played and the time point at which the angle at which the multifocal VR image data is incident on the user's eye is adjusted by the focal length, thereby adjusting the angle at which the multifocal VR image data is incident on the user's eye by the focal length.

[0007] In some embodiments, the tracked viewpoint includes the user's right eye viewpoint and left eye viewpoint, and the multifocal VR image data includes, at a first focal length, first right eye image data corresponding to the right eye viewpoint and first left eye image data corresponding to the left eye viewpoint, and at a second focal length, second right eye image data corresponding to the right eye viewpoint and second left eye image data corresponding to the left eye viewpoint.

[0008] In some embodiments, the one or more focus image data is data in which the original image data corresponding to the first tracking data is down-scaled by the rendering server device, and the step of receiving the one or more focus image data corresponding to the first tracking data from the rendering server device includes the step of receiving filter data corresponding to the image filter used for down-scaling from the rendering server device.

[0009] In some embodiments, the step of generating the multifocal VR image data by up-scaling the extracted one or more regions comprises the step of generating up-scaled image data by up-scaling the extracted one or more regions based on the filter data, and the step of generating the multifocal VR image data based on the up-scaled image data.

[0010] In some embodiments, the step of obtaining the second tracking data by tracking the user's viewpoint during the reference time interval includes the step of tracking the user's face movement and pupil movement during the reference time interval, and the step of obtaining the second tracking data based on the tracked face movement and the tracked pupil movement.

[0011] In some embodiments, the step of tracking the movement of the user's face and the movement of the pupil during the reference time interval includes the step of tracking the movement of the face by tracking the pan, tilt, and roll of the user's face.

[0012] A stereoscopic image generating device according to one embodiment of the present disclosure includes: a sensor device that tracks a user's motion during a reference time interval to acquire first tracking data and provides it to a rendering server device, and tracks the user's viewpoint during the reference time interval to acquire second tracking data; an image interface device that receives one or more focus image data corresponding to the first tracking data from the rendering server device; a signal processing device that, based on the second tracking data, extracts one or more regions corresponding to the tracked viewpoint from each of the one or more focus image data and upscales the extracted one or more regions to generate multi-focus VR (Virtual Reality) image data; and a display device that visually provides the multi-focus VR image data to the user.

[0013] In some embodiments, the display device includes a binocular display device for playing the multifocal VR video data, and a variable focus optical system for adjusting the angle at which the multifocal VR video data is incident on the user's eye according to the focal length by synchronizing the time point for playing the multifocal VR video data and the time point for adjusting the angle at which the multifocal VR video data is incident on the user's eye according to the focal length.

[0014] In some embodiments, the sensor device includes a first sensor device that generates the first tracking data by tracking the motion of the user during the reference time interval, and a second sensor device that generates the second tracking data by tracking the viewpoint of the user during the reference time interval.

[0015] In some embodiments, the signal processing device comprises: an image decoder that decodes one or more focus image data received from the image interface device; a viewpoint synthesizer that extracts one or more regions corresponding to the tracked viewpoint from the decoded one or more focus image data; an image corrector that upscales the extracted one or more regions to generate the multi-focus VR image data; and a driving signal generator that generates a driving synchronization signal to drive the display device so that the display device visually provides the multi-focus VR image data to a user.

[0016] In some embodiments, the one or more focus image data is data in which the original image data corresponding to the first tracking data is down-scaled by the rendering server device, and the image interface device receives filter data corresponding to the image filter used for down-scaling from the rendering server device.

[0017] In some embodiments, the signal processing device includes an up-scaling module that receives filter data from the image interface device and up-scales one or more extracted images based on the filter data to generate up-scaled image data. Effects of the invention

[0018] According to one embodiment of the present disclosure, a stereoscopic image generating device and a method of operating the same are provided.

[0019] In addition, a stereoscopic image generating device and a method of operating the same are provided, which rapidly generate multi-focal stereoscopic images according to changes in the user's viewpoint by receiving one or more stereoscopic images of different focal lengths from an external server and then directly extracting a stereoscopic image corresponding to the user's viewpoint. Brief explanation of the drawing

[0020] FIG. 1 is a block diagram illustrating a stereoscopic image generating device according to an embodiment of the present disclosure. FIG. 2 is a block diagram illustrating a signal processing device of FIG. 1 according to some embodiments of the present disclosure. FIG. 3 is a drawing illustrating one or more focus image data according to some embodiments of the present disclosure. FIG. 4 is a drawing illustrating a time-synthesized operation according to some embodiments of the present disclosure. FIG. 5 is a flowchart illustrating a method of operation of a stereoscopic image generating device according to some embodiments of the present disclosure. Specific details for implementing the invention

[0021] In the following, embodiments of the present invention will be described clearly and in detail so that a person skilled in the art can easily practice the present invention.

[0022] Terms such as "module" used below or functional blocks illustrated in the drawings may be implemented in the form of software configurations, hardware configurations, or combinations thereof. In order to clearly explain the technical concept of the present invention, detailed descriptions of redundant components are omitted below.

[0023] FIG. 1 is a block diagram illustrating a stereoscopic image generating device according to an embodiment of the present disclosure. Referring to FIG. 1, a stereoscopic image generating device (100) is shown.

[0024] The stereoscopic image generating device (100) can communicate with an external rendering server device. The rendering server device can render stereoscopic images corresponding to the user's movements. The stereoscopic image generating device (100) can recognize the user's movements and generate multi-focus stereoscopic image data based on image data obtained from the rendering server device, and provide it visually to the user.

[0025] The stereoscopic image generating device (100) may include a sensor device (110), an image interface device (120), a signal processing device (130), and a display device (140).

[0026] The sensor device (110) may include a motion tracking sensor and a viewpoint tracking sensor.

[0027] A motion tracking sensor can generate first tracking data (TD1) by tracking the user's motion during a reference time interval. The first tracking data (TD1) may include information corresponding to changes in the user's position in three-dimensional space or changes in the position of the user's head.

[0028] The viewpoint tracking sensor can acquire second tracking data (TD2) by tracking the user's viewpoint during a reference time interval. The second tracking data (TD2) may include information corresponding to the movement of the user's face and the movement of the user's pupils. The second tracking data can track the movement of the user's left pupil and right pupil.

[0029] The sensor device (110) can track facial movements by tracking the pan, tilt, and roll of the user's face. The pan of the face can correspond to left-right rotation of the user's face. The tilt of the face can correspond to up-down rotation of the user's face. The roll of the face can correspond to left-right tilting.

[0030] The sensor device (110) can provide the first tracking data (TD1) to a rendering server device outside the stereoscopic image generating device (100). The sensor device (110) can provide the second tracking data (TD2) to a signal processing device (130).

[0031] The image interface device (120) may receive one or more focus image data (VRD) corresponding to the first tracking data (TD1) from the rendering server device. The one or more focus image data (VRD) may mean image data for one focus or image data for two or more focuses. The one or more focus image data (VRD) may include image information and depth information corresponding to each of one or more focal lengths. In other words, the image interface device (120) may receive image information and depth information corresponding to each of one or more focal lengths from the server rendering device. A more detailed description of the one or more focus image data (VRD) will be given later with reference to FIGS. 3 and FIGS. 4.

[0032] One or more focus image data (VRD) are image data rendered in correspondence with the first tracking data (TD1) and may include information regarding images corresponding to all rotation angles of the user's gaze. In other words, one or more focus image data (VRD) may include information regarding images corresponding to the user's 360-degree gaze at a changed position in the user's three-dimensional space.

[0033] One or more focal image data (VRD) may be data in which original image data has been downscaled by a rendering server device. The original image data may include one or more focal length-specific image data as initial image data rendered by the rendering server device in response to the first tracking data (TD1).

[0034] The image interface device (120) can receive filter data used when down-scaling original image data into one or more focus image data from a rendering server device. The filter data may include filter parameters of an image filter used to down-scale the original image data, and information regarding an applied offset filter.

[0035] The image interface device (120) can receive additional data from the rendering server device. The additional data may include information regarding the difference between image data according to one or more focal lengths of the original image data. The image interface device (120) can receive filter data and additional data by including them in one or more focal image data (VRD).

[0036] The video interface device (120) can provide one or more focus image data (VRD) received from the rendering server device to the signal processing device (130).

[0037] The signal processing device (130) can receive one or more focus image data (VRD) from the image interface device (120). The signal processing device (130) can receive second tracking data (TD2) from the sensor device (110).

[0038] The signal processing device (130) can extract one or more regions corresponding to the tracked time of the second tracking data (TD2) from each of one or more focus image data (VRD) based on the second tracking data (TD2). The operation of the signal processing device (130) to extract one or more regions corresponding to the tracked time may be referred to as time-view synthesis. A more detailed description of time-view synthesis will be given later with reference to FIG. 4.

[0039] The signal processing device (130) can generate multi-focus VR (Virtual Reality) image data by up-scaling one or more extracted regions. The multi-focus VR image data may include information regarding one or more VR images for each focal length corresponding to the user's position and the user's viewpoint in three-dimensional space.

[0040] The signal processing device (130) can generate a driving signal to drive the display device (140) so that the display device (140) displays multi-focus VR video data.

[0041] The driving signal may include driving image data (DID) to be displayed on the display device (140). The driving image data (DID) may include multi-focus VR image data and information regarding the time at which the multi-focus VR image data is played on the display device (140). The driving image data (DID) may include left-eye driving image data (DID-L) provided to the user's left eye and right-eye driving image data (DID-R) provided to the user's right eye.

[0042] The driving signal may include a driving synchronization signal (DSS) that drives the display device (140) so that the display device (140) can adjust the angle at which multifocal VR video data is incident on the user's eye according to focal length. A more detailed description of the driving synchronization signal (DSS) will be provided later together with the display device (140).

[0043] The display device (140) can visually provide multi-focus VR video data to the user based on a driving signal. The display device (140) can receive driving video data (DID) and a driving synchronization signal (DSS) from a signal processing device. The display device (140) may include a binocular display device (141) and a variable focus optical system (142).

[0044] The binocular display device (141) can play multifocal VR video data. The binocular display device (141) may include a left eye display device (141-L) corresponding to the user's left eye and a right eye display device (141-R) corresponding to the user's right eye. The left eye display device (141-L) can display left eye driven video data (DID-L). The right eye display device (141-R) can display right eye driven video data (DID-R).

[0045] The variable focus optical system (142) can be positioned between the binocular display device (141) and the user's eyes. The variable focus optical system (142) can adjust the angle at which multifocal VR video data is incident on the user's eyes according to focal length. That is, the variable focus optical system (142) can operate to configure the display device (140) similarly to a light field display device.

[0046] The variable focus optical system (142) can receive a driving synchronization signal (DSS) from the signal processing device (130). Based on the driving synchronization signal (DSS), the variable focus optical system (142) can synchronize the time point for playing multi-focus VR video data and the time point for adjusting the angle at which the multi-focus VR video data enters the user's eye according to the focal length, thereby adjusting the angle at which the multi-focus VR video data enters the user's eye according to the focal length.

[0047] For example, when the binocular display device (141) plays driving image data (DID) corresponding to a first time point, the variable focus optical system (142) can adjust the angle at which multi-focus VR image data corresponding to the first time point is incident on the user's eye according to the focal length based on the driving synchronization signal (DSS).

[0048] FIG. 2 is a block diagram illustrating a signal processing device of FIG. 1 according to some embodiments of the present disclosure. Referring to FIG. 2, a signal processing device (130) is shown. The signal processing device (130) of FIG. 2 may correspond to the signal processing device (130) of FIG. 1.

[0049] The signal processing device (130) may include an image decoder (131), a viewpoint synthesizer (132), an image corrector (133), and a driving signal generator (134).

[0050] The image decoder (131) can receive one or more focus image data (VRD) from the image interface device (120). The image decoder (131) can decode one or more focus image data (VRD) to generate one or more decoded focus image data (D-VRD).

[0051] The viewpoint synthesizer (132) can receive second tracking data (TD2) from the sensor device (110). The viewpoint synthesizer (132) can receive one or more focus image data (D-VRD) decoded from the image decoder (131).

[0052] The viewpoint synthesizer (132) can generate viewpoint composite data (PSD) by extracting one or more regions corresponding to the user's viewpoint from one or more decoded focus image data (D-VRD) based on the second tracking data. The viewpoint composite data (PSD) may indicate a part corresponding to the user's viewpoint, i.e., a specific viewing angle, from one or more decoded image data (D-VRD). A more detailed explanation regarding this will be described later with reference to FIG. 4.

[0053] The image corrector (133) can receive viewpoint composite data (PSD) from the viewpoint synthesizer (132). The image corrector (133) can receive additional data and filter data from the image interface device (120).

[0054] The image corrector (133) can generate corrected image data (CID) by correcting the viewpoint composite data (PSD) based on additional data and filter data. The corrected image data (CID) may also be referred to as multi-focus VR image data. The image corrector (133) can improve the image quality of the viewpoint composite data (PSD) based on the additional data.

[0055] The image corrector (133) may include an up-scaling module. The up-scaling module can generate up-scaled image data by up-scaling the viewpoint composite data (PSD) based on filter data. The resolution of the up-scaled image data may be higher than the resolution of the viewpoint composite data (PSD).

[0056] The driving signal generator (134) can receive corrected image data (CID) from the image corrector (133). The driving signal generator (134) can generate left eye driving image data (DID-L), right eye driving image data (DID-R), and driving synchronization signal (DSS) based on the corrected image data (CID).

[0057] The driving signal generator (134) can provide left-eye driving image data (DID-L) to the left-eye display device (141-L). The driving signal generator (134) can provide right-eye driving image data (DID-R) to the right-eye display device (141-R). The driving signal generator (134) can provide a driving synchronization signal (DSS) to the variable focus optical system (142).

[0058] FIG. 3 is a drawing illustrating one or more focus image data according to some embodiments of the present disclosure. Referring to FIG. 3, part of the process of a rendering server device generating one or more focus image data is described.

[0059] A rendering server device can generate one or more focal image data based on one or more focal length-specific image data. For example, in a first direction (D1), a first plane (P1) representing image data of a first focal length (f1) may include a first object (O1). In a first direction (D1), a second plane (P2) representing image data of a second focal length (f2) may include a second object (O2). In a first direction (D1), a third plane (P3) representing image data of a third focal length (f3) may include a third object (O3).

[0060] A rendering server device can generate one or more focused image data including first to third objects (O1 to O3) based on first to third planes (P1 to P3). A more detailed description of one or more focused image data including first to third objects (O1 to O3) will be given later with reference to FIG. 4.

[0061] FIG. 3 illustrates the first to third planes (P1 to P3) as finite planes, but the scope of the present disclosure is not limited thereto, and the size of each of the first to third planes (P1 to P3) is not limited and may not be planes, and the number of focal lengths may be two or fewer or four or more.

[0062] FIG. 4 is a diagram illustrating a viewpoint synthesis operation according to some embodiments of the present disclosure. Referring to FIG. 4, one or more focus image data and a viewpoint synthesis operation are described. The first to third objects (O1 to O3) of FIG. 4 may correspond to the first to third objects (O1 to O3) of FIG. 3.

[0063] One or more focal image data may include left eye and right eye image data for one or more focal lengths.

[0064] For example, the data may include left eye image data (f1L) at a first focal length and right eye image data (f1R) at a first focal length. The signal processing device may generate left eye driving image data based on the left eye image data (f1L) at the first focal length. The signal processing device may generate right eye driving image data based on the right eye image data (f1R) at the first focal length.

[0065] The left eye image data (f1L) and the right eye image data (f1R) of the first focal length can clearly display the first object (O1) and display the second object (O2) and the third object (O3) blurry.

[0066] For example, one or more focal image data may include left eye image data (f2L) of a second focal length and right eye image data (f2R) of a second focal length. A signal processing device may generate left eye driving image data based on the left eye image data (f2L) of the second focal length. A signal processing device may generate right eye driving image data based on the right eye image data (f2R) of the second focal length.

[0067] The left eye image data (f2L) and the right eye image data (f2R) of the second focal length can clearly display the second object (O2) and display the first object (O1) and the third object (O3) blurry.

[0068] For example, one or more focal image data may include left eye image data (f3L) at a third focal length and right eye image data (f3R) at a third focal length. The signal processing device may generate left eye driving image data based on the left eye image data (f3L) at the third focal length. The signal processing device may generate right eye driving image data based on the right eye image data (f3R) at the third focal length.

[0069] The left eye image data (f3L) and the right eye image data (f3R) of the third focal length can clearly display the third object (O3) and display the first object (O1) and the second object (O2) blurry.

[0070] From one or more focus image data, the signal processing device can extract an area corresponding to the user's tracked time point.

[0071] For example, a first region (VA1) corresponding to the user's tracked left eye viewpoint in the left eye image data (f1L) of the first focal length can be indicated by a square dotted line. The first region (VA1) can move in the direction indicated by the horizontal and vertical arrows according to changes in the user's tracked viewpoint. Although FIG. 4 shows only the first region (VA1), the second to sixth regions can be extracted from each of the right eye image data (f1R) of the first focal length, the left eye image data (f2L) of the second focal length, the right eye image data (f2R) of the second focal length, the left eye image data (f3L) of the third focal length, and the right eye image data (f3R) of the third focal length. The viewpoint composite data may include the first to sixth regions.

[0072] FIG. 4 illustrates one or more focus image data as a finite plane, but the scope of the present disclosure is not limited thereto, and each of the one or more focus image data may not be a plane.

[0073] FIG. 5 is a flowchart illustrating a method of operation of a stereoscopic image generating device according to some embodiments of the present disclosure. A method of operation of a stereoscopic image generating device is described with reference to FIG. 5. The stereoscopic image generating device of FIG. 5 may correspond to the stereoscopic image generating device (100) of FIG. 1.

[0074] In step S110, the stereoscopic image generating device can acquire first tracking data by tracking the user's motion during a reference time interval.

[0075] In step S120, the stereoscopic image generating device can acquire second tracking data by tracking the user's viewpoint during a reference time interval.

[0076] In some embodiments, step S110 may include tracking the movement of the user's face and the movement of the pupil during a reference time interval, and acquiring second tracking data based on the tracked face movement and the tracked pupil movement.

[0077] In step S130, the stereoscopic image generating device can provide the first tracking data to the rendering server device.

[0078] In step S140, the stereoscopic image generating device may receive one or more focus image data corresponding to the first tracking data from the rendering server device.

[0079] In step S150, the stereoscopic image generating device can extract one or more regions corresponding to the tracked time point from each of one or more focus image data based on the second tracking data.

[0080] In step S160, the stereoscopic image generating device can generate multifocal VR image data by up-scaling one or more extracted regions.

[0081] In some embodiments, step S160 may include up-scaling regions extracted based on filter data to generate up-scaled image data, and generating multi-focus VR image data based on the up-scaled image data.

[0082] In step S170, the stereoscopic image generating device can visually provide multi-focus VR image data to the user by means of the display device of the stereoscopic image generating device.

[0083] In some embodiments, step S170 may include playing multifocal VR video data by a binocular display, and adjusting the angle at which the multifocal VR video data is incident on the user's eyes by focal length by synchronizing with the binocular display by a variable focus optical system.

[0084] The above description describes specific embodiments for implementing the present invention. The present invention will include not only the embodiments described above, but also embodiments that can be simply modified or easily modified. Furthermore, the present invention will include technologies that can be easily modified and implemented using the embodiments. Accordingly, the scope of the present invention should not be limited to the embodiments described above, but should be defined by the claims set forth below as well as equivalents to the claims of this invention. Explanation of the symbols

[0085] 100: Stereoscopic image generating device 110: Sensor device 120: Video interface device 130: Signal processing unit 140: Display device

Claims

Claim 1 A method of operating a stereoscopic image generating device communicating with a rendering server device, comprising: a step of acquiring first tracking data by tracking a user's motion during a reference time interval; a step of acquiring second tracking data by tracking the user's viewpoint during the reference time interval; a step of providing the first tracking data to the rendering server device; a step of receiving one or more focal image data corresponding to the first tracking data from the rendering server device; a step of extracting one or more regions corresponding to the tracked viewpoint from each of the one or more focal image data based on the second tracking data; a step of generating multi-focal VR (Virtual Reality) image data by up-scaling the extracted one or more regions; and a step of visually providing the multi-focal VR image data to the user by means of a display device of the stereoscopic image generating device. Claim 2 In claim 1, the display device comprises a binocular display device and a variable focus optical system, and the step of visually providing the multifocal VR image data to the user by means of the display device of the stereoscopic image generating device comprises: a step of playing the multifocal VR image data by means of the binocular display; and a step of synchronizing a time point for playing the multifocal VR image data and a time point for adjusting the angle at which the multifocal VR image data is incident on the user's eye by means of the variable focus optical system, thereby adjusting the angle at which the multifocal VR image data is incident on the user's eye by means of the focal distance. Claim 3 A method according to claim 1, wherein the tracked viewpoint includes the user’s right eye viewpoint and left eye viewpoint, and the multifocal VR image data comprises: at a first focal length, first right eye image data corresponding to the right eye viewpoint and first left eye image data corresponding to the left eye viewpoint; and at a second focal length, second right eye image data corresponding to the right eye viewpoint and second left eye image data corresponding to the left eye viewpoint. Claim 4 In claim 1, the one or more focus image data is data in which the original image data corresponding to the first tracking data is down-scaled by the rendering server device, and the step of receiving the one or more focus image data corresponding to the first tracking data from the rendering server device comprises: the step of receiving filter data corresponding to the image filter used for down-scaling from the rendering server device. Claim 5 In claim 4, the step of generating the multifocal VR image data by up-scaling the one or more extracted regions comprises: a step of generating up-scaled image data by up-scaling the one or more extracted regions based on the filter data; and a step of generating the multifocal VR image data based on the up-scaled image data. Claim 6 A method according to claim 1, wherein the step of obtaining the second tracking data by tracking the user's viewpoint during the reference time interval comprises: the step of tracking the movement of the user's face and the movement of the pupil during the reference time interval; and the step of obtaining the second tracking data based on the tracked movement of the face and the tracked movement of the pupil. Claim 7 In claim 6, the step of tracking the movement of the user's face and the movement of the pupil during the reference time interval comprises: a step of tracking the movement of the face by tracking the pan, tilt, and roll of the user's face. Claim 8 A stereoscopic image generating device comprising: a sensor device that tracks a user's motion during a reference time interval to acquire first tracking data and provides it to a rendering server device, and tracks the user's viewpoint during the reference time interval to acquire second tracking data; an image interface device that receives one or more focus image data corresponding to the first tracking data from the rendering server device; a signal processing device that, based on the second tracking data, extracts one or more regions corresponding to the tracked viewpoint from each of the one or more focus image data and upscales the extracted one or more regions to generate multi-focus VR (Virtual Reality) image data; and a display device that visually provides the multi-focus VR image data to the user. Claim 9 In claim 8, the display device comprises: a binocular display device that plays the multifocal VR image data; and a stereoscopic image generating device comprising a variable focus optical system that adjusts the angle at which the multifocal VR image data is incident on the user's eye according to the focal length by synchronizing the time point at which the multifocal VR image data is played and the time point at which the angle at which the multifocal VR image data is incident on the user's eye according to the focal length. Claim 10 In claim 8, the sensor device comprises: a first sensor device that generates the first tracking data by tracking the motion of the user during the reference time interval; and a second sensor device that generates the second tracking data by tracking the viewpoint of the user during the reference time interval. Claim 11 In claim 8, the signal processing device comprises: an image decoder that decodes one or more focus image data received from the image interface device; a viewpoint synthesizer that extracts one or more regions corresponding to the tracked viewpoint from the decoded one or more focus image data; an image corrector that upscales the extracted one or more regions to generate the multi-focus VR image data; and a driving signal generator that generates a driving synchronization signal to drive the display device so that the display device visually provides the multi-focus VR image data to a user. Claim 12 In claim 8, the one or more focus image data is data in which the original image data corresponding to the first tracking data is down-scaled by the rendering server device, and the image interface device is a stereoscopic image generating device that receives filter data corresponding to the image filter used for down-scaling from the rendering server device. Claim 13 In claim 12, the signal processing device comprises: a stereoscopic image generating device including an upscaling module that receives filter data from the image interface device and upscales the extracted plurality of images based on the filter data to generate upscaled image data.

Images