Processing device and processing method

Abstract

To more appropriately determine a possibility that a specific symptom occurs when a user views a VR moving image.SOLUTION: A processing device comprises: acquisition means for acquiring a VR moving image including a first image to be displayed for a right eye of a user and a second image to be displayed for a left eye of the user; and determination means for determining a possibility that a specific symptom occurs on the user because of viewing the VR moving image based on information of a content of the VR moving image, information of the user and characteristics of the VR moving image.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a processing device and a processing method for performing processing related to VR moving images. [Background technology]

[0002] In recent years, imaging devices for acquiring photographs or videos that allow stereoscopic viewing have been attracting attention. Also, display devices for viewing VR (virtual reality) videos with high immersiveness and realism have been attracting attention. On the other hand, when a user wears a head-mounted display (HMD) or the like and watches a VR video, the user may feel fatigue or VR sickness.

[0003] Methods for determining the possibility of symptoms such as fatigue or VR sickness occurring and reducing them have been proposed. Patent Document 1 discloses an apparatus and method for lowering the contrast ratio of VR videos according to the age of a user in order to reduce eye fatigue and discomfort of the user. Patent Document 2 discloses an apparatus for adjusting the parallax amount of a stereoscopic image according to the broadcast time and genre (genre such as drama, documentary, baseball, or soccer) of the stereoscopic image in order to reduce eye fatigue of a user watching the stereoscopic image. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-69045 [Patent Document 2] JP 2011-193461 A [Non-patent literature]

[0005] [Non-Patent Document 1] Takayuki Ito, "Research Results of 3D Television at NHK STRL," NHK STRL R&D, 2010, No. 123, pp. 48-55 Summary of the Invention [Problem to be solved by the invention]

[0006] For example, assume that, in two VR videos of documentary genre, one video is a video of a cityscape taken from a vehicle (such as a car or train), and the other video is a video of a field taken from a fixed point. In this case, when a user watches a video of a cityscape taken from a vehicle, the user may experience VR sickness. On the other hand, when the same user watches a video taken from a fixed point, the user may not experience VR sickness. However, the techniques disclosed in Patent Documents 1 and 2 only use the user's age and the genre of the VR video, and therefore cannot appropriately determine the possibility of symptoms such as VR sickness or fatigue occurring in such two videos.

[0007] Therefore, an object of the present invention is to provide a technology for more appropriately determining the possibility that a specific symptom will occur when a user watches a VR video. [Means for solving the problem]

[0008] One aspect of the present invention is a method for producing a composition comprising the steps of: An acquisition means for acquiring a VR video including a first image for displaying to a right eye of a user and a second image for displaying to a left eye of the user; Based on the content information of the VR video, the user information, and the characteristics of the VR video, A determination means for determining a possibility that a specific symptom will occur in the user due to watching the VR video; The processing apparatus is characterized by having:

[0009] One aspect of the present invention is a method for producing a composition comprising the steps of: acquiring a VR video including a first image for displaying to a right eye of a user and a second image for displaying to a left eye of the user; A determination step of determining the possibility that a specific symptom will occur in the user due to watching the VR video based on information of the content of the VR video, information of the user, and characteristics of the VR video; The method is characterized by comprising the steps of: Effect of the Invention

[0010] According to the present invention, an object is to provide a technology for more appropriately determining the possibility that a specific symptom will occur when a user watches a VR video. [Brief description of the drawings]

[0011] [Figure 1] 1 is a block diagram of an image processing device according to a first embodiment. [Diagram 2] 4 is a flowchart of image processing according to the first embodiment. [Diagram 3] FIG. 2 is a diagram for explaining a judgment criterion according to the first embodiment. [Figure 4] FIG. 4 is a diagram showing an example of a detection limit and a tolerance limit according to the first embodiment. [Diagram 5] FIG. 2 is a diagram showing a GUI according to the first embodiment. [Figure 6] 13 is a flowchart of image processing according to Modification 1. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0013] In the following, a VR image is an image having a wider viewing range (angle of view) than the display range that can be displayed at one time on the screen of a display unit, such as a VR 360-degree image (omnidirectional image, celestial sphere image) or a VR 180-degree image (semi-celestial sphere image). For example, the image range has a maximum viewing range of 360 degrees in the up and down direction (vertical angle, angle from the zenith, elevation angle, depression angle, altitude angle, pitch angle) and 360 degrees in the left and right direction (horizontal angle, azimuth angle, yaw angle). In the case of a VR 180-degree image, each image range has a viewing range of 180 degrees. In addition, the VR image also includes a stereoscopic image in which two images with parallax are displayed side by side, and the user can feel the depth by viewing them with the left and right eyes at the same time. The VR image of this embodiment includes a video consisting of multiple frames that are consecutive in time series, and a live view image, and is particularly called a VR video. A portion of a VR image is displayed and played on the screen in the direction indicated by the user, and the user's body movements and changes in the image display occur in real time, providing the user with a high level of realism and a sense of immersion.

[0014] In this embodiment, a technology that enables a user to grasp the possibility of experiencing symptoms such as fatigue or VR sickness when watching a VR video (VR image) will be described. In the following, a user who watches a VR video will be referred to as a "viewing user." Also, symptoms such as fatigue or VR sickness caused by watching a VR video will be referred to as "VR symptoms."

[0015] For example, when a user watches moving content (VR video shot by installing a camera on a vehicle), the user is likely to feel VR sickness (a symptom similar to motion sickness caused by exposure to a VR environment) due to the mismatch between the movement (change) of the VR video and the user's body movement. In addition, the user may feel a difference in the shape (brightness, etc.) of an object between the right eye image (image displayed to be seen from the right eye) and the left eye image (image displayed to be seen from the left eye) of the VR video. In particular, when a mismatch between the VR video and the viewer's movements and a mismatch between the right eye image and the left eye image occur simultaneously, the impact on the viewer is significant.

[0016] Regarding VR symptoms, it is necessary to take into consideration children who are still growing and people with weak stereoscopic vision. For this reason, it is necessary to check whether there is a possibility that VR symptoms will occur before the user watches a VR video. However, in order to properly check (understand) the possibility, someone needs to actually watch the VR video, and there is a possibility that the person who performs the checking task may experience VR symptoms.

[0017] <Embodiment 1> 1 is a block diagram showing the configuration of an image processing device 1 according to embodiment 1. The image processing device 1 is a PC (computer), a tablet terminal, a smartphone, or the like.

[0018] The image processing device 1 has a non-volatile memory 110, a volatile memory 120, a control unit 130, an operation unit 140, a display unit 150, an external interface unit 160, a recording unit 170, and a communication unit 180. In addition, each component of the image processing device 1 is connected to each other by a bus 190. Control signals and various data output from the control unit 130 are transmitted and received via the bus 190.

[0019] The non-volatile memory 110 includes, for example, an HDD (Hard Disk Drive). The non-volatile memory 110 stores a program 10 (a program for causing the control unit 130 to execute various arithmetic processing), a VR video 20, a setting file 30 (information indicating a category of a viewing user), and the results of arithmetic processing by the control unit 130. The VR video 20 is a VR video obtained by capturing a subject. The VR video 20 includes a right eye image (an image displayed in front of the right eye) and a left eye image (an image displayed in front of the left eye).

[0020] The volatile memory 120 includes, for example, a RAM (Random Access Memory). The volatile memory 120 is used to temporarily store data. The program 10 recorded in the non-volatile memory 110 or the recording medium 3 is temporarily loaded into the volatile memory 120 and executed by the control unit 130. Furthermore, the volatile memory 120 is also used as a working memory when the control unit 130 executes arithmetic processing.

[0021] The control unit 130 controls the entire image processing device 1 according to the program 10 loaded into the volatile memory 120. The control unit 130 is capable of overall control of the image processing device 1. The control unit 130 can also execute the processing of each step of an image processing method (see FIG. 2) described later according to the program. The control unit 130 includes a CPU (Central Processing Unit) and the like.

[0022] The operation unit 140 includes operation members (such as a keyboard, a mouse, or a touch panel) that can be operated by the user. The control unit 130 can control each component of the image processing device 1 according to the content of the operation performed on the operation unit 140 by the user.

[0023] The display unit 150 displays the VR video 20, as well as a GUI screen including a GUI (Graphical User Interface). The control unit 130 outputs a control signal to each component in accordance with a program. In this way, the control unit 130 controls each component of the image processing device 1 to generate (output) a video signal for display on the display unit 150. Note that the image processing device 1 may not have the display unit 150, but may have an interface for outputting a video signal for display on the display unit 150. For this reason, The display unit 150 may be an external monitor.

[0024] The external interface unit (external I / F unit) 160 communicates with the imaging device 2 connected to the image processing device 1. The imaging device 2 is, for example, a VR camera that captures a VR video 20. The image processing device 1 and the imaging device 2 are connected by wire using a Universal Serial Bus (USB) cable. Alternatively, the image processing device 1 and the imaging device 2 may be connected wirelessly using Bluetooth (registered trademark) or the like. The VR video 20 captured by the imaging device 2 is stored in the non-volatile memory 110 via the external interface unit 160.

[0025] The recording unit 170 can read various data (such as the program 10 or the VR video 20) stored in the recording medium 3.

[0026] The communication unit 180 transmits various data (program 10 or VR video 20) to be executed by the control unit 130 to an external device (a device owned by the viewing user) via the network 4. For example, when an external device such as an HMD (head mounted display) acquires the VR video 20, it displays a range of the VR video 20 (image of a frame corresponding to the playback time) according to the posture of the viewing user's head. At this time, the external device displays a right eye image of the VR video 20 so as to be seen from the right eye of the viewing user, and displays a left eye image of the VR video 20 so as to be seen from the left eye of the viewing user.

[0027] In the first embodiment, a case will be described in which the recording medium (computer-readable recording medium) storing the program 10 is the non-volatile memory 110 or the recording medium 3. However, the program 10 may be recorded in any recording medium as long as it is a computer-readable recording medium. For example, an external storage device (not shown) may be used as a recording medium for supplying the program 10. To give a specific example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a non-volatile memory (such as a USB memory), or a ROM may be used as the recording medium. The program 10 may also be supplied to the image processing device 1 via the network 4.

[0028] (About image processing) Image processing (image processing method) according to the first embodiment will be described with reference to the flowchart in Fig. 2. Specifically, the process will be described in which a user who edits a video (hereinafter, referred to as an "editing user") checks whether or not a viewing user is likely to experience VR symptoms (such as fatigue or VR sickness) when viewing a VR video 20.

[0029] In step S201, the control unit 130 acquires the VR video 20 stored in the non-volatile memory 110. The control unit 130 may also acquire the VR video 20 stored in another configuration (the recording medium 3 or an external device) as long as the control unit 130 can acquire the VR video 20. For example, the control unit 130 may acquire the VR video 20 captured by the external device via the network 4.

[0030] In step S202, the control unit 130 acquires information indicating the category of the viewing user (viewing user information).

[0031] For example, it is assumed that two categories of viewing users can be set: "under 13 years old or those with poor stereoscopic vision" and "others." In this case, the control unit 130 acquires information indicating which of the two categories the viewing user belongs to as viewing user information. Specifically, "under 13 years old or those with poor stereoscopic vision" and When the editing user uses the operation unit 140 to input which of the "other" categories the viewing user corresponds to, the control unit 130 acquires the input result as viewing user information.

[0032] Note that the control unit 130 may acquire viewing user information from the setting file 30 in which the viewing user's category is described, instead of having the editing user input the viewing user's category. Also, instead of "under 13 years old", a lower age category such as "under 6 years old" may be set, or a category indicating an elderly person such as "65 years old or older" may be set. Note that whether or not the viewing user has poor stereoscopic vision can also be determined from, for example, the result of a Chitmus stereo test of the viewing user.

[0033] In step S203, the control unit 130 acquires content information indicating the category of the content of the VR video 20. In the first embodiment, the content information is, for example, information regarding the situation under which the VR video 20 was shot (the shooting situation of the VR video 20). As the category of the content, for example, it is assumed that three categories can be set: "mobile content (VR video shot by a camera installed on a vehicle)", "shaky content (VR video shot in a state where camera shake occurs)", and "other". In this case, the control unit 130 acquires the category corresponding to the VR video 20 among the three categories as content information. Specifically, when the editing user inputs using the operation unit 140 which of "mobile content", "shaky content", and "other" the VR video 20 corresponds to, the control unit 130 acquires the input result as the content information of the VR video 20. Here, the mobile content and the shaky content are contents that are likely to cause VR sickness (video-induced sickness).

[0034] Instead of having the editing user input the category of the content, the control unit 130 may perform video analysis of the VR video 20 to determine whether the VR video 20 is a "moving content" or a "shaky camera content". Specifically, the control unit 130 calculates the optical flow of the VR video 20. Then, when the control unit 130 determines that each object (each subject) moves in the same direction in all of the images of a plurality of consecutive frames based on the optical flow, it can determine that the VR video 20 is a "moving content". On the other hand, when the control unit 130 determines that each object moves in a first direction and a second direction repeatedly in the images of a plurality of consecutive frames based on the optical flow, it can determine that the VR video 20 is a "shaky camera content".

[0035] The viewing user information may be information about a viewing user. The viewing user information may be, for example, information indicating age or generation such as date of birth, or information about eyesight. The content information may be information about the content of the VR video 20. The content information may be, for example, information indicating whether the VR video 20 corresponds to a live-action video or an animated video.

[0036] In step S204, the control unit 130 determines a determination criterion (a criterion for determining the possibility that a VR symptom will occur in the viewing user) based on the viewing user information and the content information.

[0037] Fig. 3 is a diagram for explaining the judgment criteria according to the first embodiment. Fig. 3 shows that the judgment criteria change depending on the category of the content of the VR video 20 and the category of the viewing user. When the viewing user is "a child or a person with poor stereoscopic vision", the judgment criteria are set to be stricter (criteria that make it easier to judge that the viewing user may have VR symptoms) than when the viewing user is "others". Also, when the content is "mobile content or camera shake content", the judgment criteria are set to be stricter than when the content is "others".

[0038] Here, the judgment criteria include a binocular image characteristic criterion and a content characteristic criterion. The binocular image characteristic is a characteristic indicating the difference between the right eye image and the left eye image (at least one of size deviation, position deviation, rotation deviation, brightness difference, color difference, contrast ratio difference, and parallax). The content characteristic is a characteristic indicating the degree of movement (yaw angular velocity, pitch angular velocity, etc.) of the imaging device that captured the VR video 20. Note that the content characteristic may be a characteristic indicating the degree of movement of the subject in the VR video 20.

[0039] For example, when the control unit 130 determines that the VR video 20 is "moving content" and the viewing user is "under 13 years old," the control unit 130 determines the criteria for the binocular image characteristics that the geometric difference, brightness difference, and parallax between the right eye image and the left eye image are all 0. In this case, the control unit 130 also determines the criteria for the content characteristics that the yaw angular velocity is 35 degrees / second and the pitch angular velocity is 15 degrees / second.

[0040] Also, for example, when the control unit 130 determines that the VR video 20 is "other" and the viewing user is "under 13 years old," the control unit 130 determines the criteria for binocular image characteristics that the geometric difference and the brightness difference are at the detection limit and the parallax is half the allowable limit. In this case, the control unit 130 determines the criteria for content characteristics that are allowable regardless of the yaw angular velocity and pitch angular velocity (yaw angle and pitch angle).

[0041] Here, the detection limit is the limit at which a human can detect the existence of a difference. The tolerance limit is the limit of the difference that a human can tolerate. FIG. 4 is an example of the detection limit and tolerance limit of the difference between a right eye image and a left eye image disclosed in Non-Patent Document 1. The control unit 130 determines one criterion as the judgment criterion from a total of four criteria of 2×2 in FIG. 3 based on the content information and the viewing user information acquired in steps S202 and S203.

[0042] The judgment criteria may further be determined based on, for example, information on the image quality (frame rate or resolution, etc.) of the VR video 20. For example, the lower the frame rate of the VR video 20, the more likely it is that changes in the display range of the VR video 20 will not keep up with changes in the posture of the viewing user. For this reason, the lower the frame rate of the VR video 20, the more likely it is that the viewing user will experience VR sickness. Therefore, when the frame rate of the VR video 20 is lower than a predetermined value, even if the VR video 20 is "other than mobile content, etc.", the same judgment criteria as when the VR video 20 is "mobile content" or "shaky camera content" may be determined.

[0043] The following processing of steps S205 and S206 is executed for one frame of the VR video. Specifically, one frame of the VR video for which the processing of steps S205 and S206 has not yet been executed is selected, and the processing of steps S205 and S206 is executed for that one frame. Hereinafter, the frame that is the target of the processing of steps S205 and S206 is referred to as the "target frame."

[0044] In step S205, the control unit 130 calculates (acquires) binocular image characteristics and content characteristics of the image of the target frame. Specifically, the control unit 130 calculates the difference between the right eye image and the left eye image (size deviation, position deviation, rotation deviation, brightness difference, parallax, etc.) as the binocular image characteristics. Furthermore, if the VR video 20 is a moving content, the control unit 130 calculates the yaw angular velocity and pitch angular velocity of the imaging device 2 as the content characteristics. If the VR video 20 is a camera shake content, the control unit 130 calculates the magnitude of camera shake (yaw angle, pitch angle, etc.), which is the amount of camera shake of the imaging device 2, as the content characteristics.

[0045] Here, the control unit 130 performs image analysis of the VR video 20 to obtain the The yaw angular velocity and pitch angular velocity (or yaw angle and pitch angle) can be calculated. For this image analysis, optical flow (a technology for detecting the movement of an object from a video) can be used. Specifically, the control unit 130 calculates the movement direction (rotation direction) or velocity (angular velocity) of the imaging device 2 by analyzing the pattern of how the movement of an object between adjacent frames of the VR video 20 occurs due to the movement of the object or the imaging device 2. The control unit 130 may calculate the yaw angular velocity and pitch angular velocity (or yaw angle and pitch angle) of the imaging device 2 based on the value of an angular velocity sensor mounted on the imaging device 2.

[0046] In step S206, the control unit 130 compares the binocular image characteristics of the target frame with the judgment criteria (judgment criteria for binocular image characteristics), and further compares the content characteristics of the target frame with the judgment criteria (judgment criteria for content characteristics). If any characteristic exceeds the judgment criteria, the control unit 130 judges that the viewing user may experience a VR symptom. If the control unit 130 judges that the viewing user may experience a VR symptom, it registers the target frame in a notification list (warning list).

[0047] In step S207, the control unit 130 judges whether the calculation of the characteristics is completed for all frames of the VR video 20. If it is judged that the calculation of the characteristics is not completed for all frames, the process returns to step S205. If it is judged that the calculation of the characteristics is completed for all frames, the process proceeds to step S208.

[0048] In step S208, the control unit 130 displays the calculated characteristics side by side along with the right eye image and the left eye image. The control unit 130 also displays a graph showing the time series change of the characteristics selected by the user. At this time, if the VR video 20 includes a frame added to the notification list, the control unit 130 notifies (warns) the editing user that the viewing user may experience VR symptoms (such as fatigue or VR sickness).

[0049] 5 is a schematic diagram showing an example of GUI 5 displayed on display unit 150 when an editing user checks a VR video 20. GUI 5 includes a VR video list 510 (a list showing a plurality of VR videos 20), a display area 520 (an area for displaying the VR videos 20), and a display area 530 (an area for displaying characteristics of the VR videos 20). GUI 5 also includes a bar 540 (progress bar) showing the playback position (playback time) of the VR video 20, a pull-down 550 for the user to select characteristics, time-series graphs 551 to 553 of characteristics, and the like.

[0050] In the display area 520, an image of a frame of the VR video 20 at the playback time specified in the bar 540 is displayed (a right eye image and a left eye image are displayed).

[0051] In the display area 530, the file name and size of the VR moving image 20 as well as the characteristics of the image of the frame corresponding to the playback time indicated by the bar 541 are displayed. Time series graphs 551 to 553 show the time series changes in the characteristics (characteristics selected by the pull-down menu 550). Time series graph 551 shows the time series changes in the characteristics of the left eye image, and time series graph 552 shows the time series changes in the characteristics of the right eye image. Time series graph 553 shows the difference between time series graph 551 and time series graph 552 of the characteristics of the VR moving image 20 (difference in characteristics between the right eye image and the left eye image).

[0052] Furthermore, if there is a frame registered in the notification list (hereinafter referred to as a "notification frame"), the control unit 130 displays (highlights; notifies) the section of the VR video 20 corresponding to the notification frame so that the editing user can easily grasp it. Specifically, in the GUI 5, the control unit 130 highlights the position 541 (section) in the bar 540 that corresponds to the notification frame, and the position 554 (section) in the time series graph 553 that corresponds to the notification frame. Furthermore, if the image of the frame displayed in the display area 520 is an image of the notification frame, the outer frame of the display area 520 may be highlighted. In this case, for example, the outer frame of the display area 520 is set to a thick frame. Alternatively, the outer frame may be displayed in red or the like.

[0053] The control unit 130 notifies the editing user that the viewing user may experience a VR symptom by highlighting and displaying a position corresponding to the notification frame in the time series graph 553 or the bar 540. However, the control unit 130 may notify the editing user that the viewing user may experience a VR symptom by any method. For example, the control unit 130 may display a display item on the display unit 150 that indicates, by means of text, that the viewing user may experience a specific symptom when viewing the VR video 20. The control unit 130 may notify the editing user that the viewing user may experience a specific symptom when viewing the VR video 20 by outputting a sound.

[0054] As described above, according to the image processing device 1 of embodiment 1, the editing user can appropriately check the possibility that the viewing user will experience VR symptoms (such as fatigue or VR sickness) when watching a VR video, without actually watching the VR video.

[0055] Note that the first embodiment is not limited to the above example, and the image processing device 1 may determine the possibility that the VR symptoms will occur in the viewing user based on the information on the content of the VR video, the information on the viewing user, and the characteristics of the VR video by any method. For example, assume that the image processing device 1 has a machine learning learning device (artificial intelligence). In this case, the learning device is trained in advance by inputting information on a combination of the information on the content of the VR video, the information on the viewing user, and the characteristics of the VR video, and a result of whether or not the VR symptoms have occurred in the viewing user in the case of the combination. Then, when the image processing device 1 makes a determination, the image processing device 1 may determine the possibility that the VR symptoms will occur in the viewing user by inputting the combination of the information on the content of the VR video, the information on the viewing user, and the characteristics of the VR video into the learning device.

[0056] <Variation 1> In the first modification, an image processing device 1 that performs image processing (video editing) for reducing the possibility of occurrence of VR symptoms (symptoms such as fatigue or VR sickness) in addition to the processing according to the first embodiment will be described.

[0057] Image processing (image processing method) according to Modification 1 will be described below with reference to Fig. 6. Note that the processes in steps S201 to S208 are similar to the processes in the same steps according to the first embodiment, and therefore description thereof will be omitted.

[0058] In step S609, the control unit 130 performs image processing on the VR video 20 to reduce the possibility of VR symptoms occurring when the VR video 20 is viewed (to reduce the VR symptoms). For example, regarding the geometric deviation between the right eye image and the left eye image, the control unit 130 calculates corresponding points between the right eye image and the left eye image, corrects the magnification and position of the right eye image and the left eye image so that the positions of the corresponding points of the two images match, and rotates these images. Regarding the difference in brightness between the right eye image and the left eye image, the control unit 130 calculates, for example, the brightness histograms of the right eye image and the left eye image, and corrects the brightness values ​​of the right eye image and the left eye image so that the two brightness histograms match. The control unit 130 displays the corrected VR video in the display area 520. Finally, the control unit 130 saves the corrected VR video 20 in a non-volatile memory (performs file saving).

[0059] Furthermore, instead of correcting the VR video 20 in this manner, the control unit 130 may remove (cut) the frames registered in the notification list from the VR video 20 and generate a new VR video.

[0060] The image processing in step S609 may be executed when the editing user presses an image processing button 560 as shown in Fig. 5. The file saving of the corrected VR video 20 may be executed when the editing user presses an export button 570.

[0061] Furthermore, the process of step S609 may be executed only when the VR video 20 includes a notification frame, or may be executed in any case.

[0062] As described above, the image processing device 1 according to the first variant example makes it possible to check the possibility of VR symptoms (such as fatigue or VR sickness) occurring when watching a VR video, and can generate a VR video that reduces the possibility of the occurrence of VR symptoms.

[0063] Also, in the above, "If A is equal to or greater than B, proceed to step S1, and if A is smaller (lower) than B, proceed to step S2" may be read as "If A is greater (higher) than B, proceed to step S1, and if A is equal to or less than B, proceed to step S2." Conversely, "If A is greater (higher) than B, proceed to step S1, and if A is equal to or less than B, proceed to step S2" may be read as "If A is greater (higher) than B, proceed to step S1, and if A is smaller (lower) than B, proceed to step S2." For this reason, unless a contradiction occurs, the expression "equal to or greater than A" may be read as "A or greater (high; long; many)," or may be read as "greater than A (high; long; many)." On the other hand, the expression "equal to or less than A" may be read as "A or smaller (low; short; few)," or may be read as "smaller than A (low; short; few)." Furthermore, "bigger (higher; longer; more) than A" may be read as "A or greater," and "smaller (lower; shorter; fewer) than A" may be read as "A or less."

[0064] Although the present invention has been described in detail based on the preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Parts of the above-described embodiments may be combined as appropriate.

[0065] Each functional unit in each of the above embodiments (variations) may or may not be individual hardware. The functions of two or more functional units may be realized by common hardware. Each of a plurality of functions of one functional unit may be realized by individual hardware. Two or more functions of one functional unit may be realized by common hardware. Furthermore, each functional unit may or may not be realized by hardware such as an ASIC, FPGA, or DSP. For example, the device may have a processor and a memory (storage medium) in which a control program is stored. Then, the functions of at least some of the functional units of the device may be realized by the processor reading and executing the control program from the memory.

[0066] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) for implementing one or more of the functions.

[0067] The disclosure of the above embodiments includes the following configurations, methods, and programs. (Configuration 1) An acquisition means for acquiring a VR video including a first image for displaying to a right eye of a user and a second image for displaying to a left eye of the user; Based on the content information of the VR video, the user information, and the characteristics of the VR video, A determination means for determining a possibility that a specific symptom will occur in the user due to watching the VR video; A processing device comprising: (Configuration 2) The determination means determines the possibility that the specific symptom will occur in the user due to watching the VR video, based on a result of comparing a criterion according to information on the content of the VR video and information on the user with a characteristic of the VR video. 2. The processing device according to configuration 1. (Configuration 3) The user information is information based on at least one of the user's age and the state of the user's stereoscopic vision function. 3. The processing device according to configuration 1 or 2. (Configuration 4) The information on the content of the VR video is information on the situation when the VR video was shot, 4. The processing device according to any one of configurations 1 to 3. (Configuration 5) The information on the content of the VR video includes information on whether the VR video is a video captured by an imaging device installed in a vehicle, or information on whether the VR video is a video captured in a state where camera shake is occurring. The processing device according to configuration 4, characterized in that it acquires. (Configuration 6) Further comprising an image processing means for performing image processing on the VR video to reduce the possibility that the specific symptom will occur in the user when the determination means determines that the specific symptom will occur in the user. 6. The processing device according to any one of configurations 1 to 5, comprising: (Configuration 7) The device further includes a notification means for notifying the user of the possibility of the specific symptom occurring when the determination means determines that the specific symptom may occur. 7. The processing device according to any one of configurations 1 to 6. (Configuration 8) The notification means displays the first image and the second image, and also displays characteristics of the VR video. 8. The processing device according to configuration 7. (Configuration 9) The notification means displays the first image and the second image, and also displays a graph showing a time series change in a characteristic of the VR video. 9. The processing device according to configuration 7 or 8. (Configuration 10) The determination means determines a frame in the VR video in which the specific symptom is likely to occur in the user, the notification means, when it is determined by the determination means that the specific symptom is likely to occur in the user, notifies the user of a frame section in which the specific symptom is likely to occur in the user. 10. The processing device according to any one of configurations 7 to 9. (Configuration 11) When the determination means determines that the specific symptom may occur in the user and a graph showing a time-series change in the characteristics of the VR video is displayed, the notification means notifies the user of a frame in the graph in which the specific symptom may occur in the user. Highlight the position corresponding to 11. The processing device according to configuration 10. (Configuration 12) The characteristics of the VR video include a first characteristic indicating a difference between the first image and the second image, and a second characteristic indicating a degree of movement of an imaging device that captured the VR video. 12. The processing device according to any one of configurations 1 to 11. (Configuration 13) The first characteristic includes at least one of a size shift, a position shift, a rotation shift, a brightness difference, a color difference, a contrast ratio difference, and a parallax between the first image and the second image. 13. The processing device according to configuration 12. (Configuration 14) When the VR video is content captured by an imaging device installed in a vehicle, the second characteristic is a yaw angular velocity and a pitch angular velocity of the imaging device; If the VR video is a content shot while camera shake is occurring, the second characteristic is the magnitude of the camera shake. 14. The processing device according to claim 12 or 13. (Configuration 15) The specific symptom is at least one of fatigue and VR sickness, 15. The processing device according to any one of configurations 1 to 14. (method) acquiring a VR video including a first image for displaying to a right eye of a user and a second image for displaying to a left eye of the user; A determination step of determining the possibility that a specific symptom will occur in the user due to watching the VR video based on information of the content of the VR video, information of the user, and characteristics of the VR video; A processing method comprising the steps of: (program) A program for causing a computer to function as each of the means of the processing device according to any one of configurations 1 to 15. [Explanation of symbols]

[0068] 1: image processing device, 20: VR video, 130: control unit

Claims

1. an acquisition means for acquiring a VR video including a first image to be displayed to the right eye of a user and a second image to be displayed to the left eye of the user; A determination means for determining the possibility that a specific symptom will occur in the user due to watching the VR video, based on information about the content of the VR video, information about the user, and characteristics of the VR video; A processing device comprising:

2. The determination means determines the possibility that the specific symptom will occur in the user due to watching the VR video, based on a result of comparing a criterion according to information on the content of the VR video and information on the user with a characteristic of the VR video.

2. The processing device according to claim 1.

3. The user information is information based on at least one of the user's age and the state of the user's stereoscopic vision function.

3. The processing apparatus according to claim 1 or 2.

4. The information about the content of the VR video is information about the situation when the VR video was shot.

3. The processing apparatus according to claim 1 or 2.

5. The information on the content of the VR video includes information on whether the VR video is a video shot by an imaging device installed in a vehicle, or information on whether the VR video is a video shot in a state where camera shake occurs.

5. The processing device according to claim 4.

6. The method further includes an image processing means for, when the determination means determines that the specific symptom is likely to occur in the user, performing image processing on the VR video to reduce the possibility that the specific symptom will occur in the user.

3. The processing apparatus according to claim 1 or 2.

7. The device further includes a notification means for notifying the user that the specific symptom may occur when the determination means determines that the specific symptom may occur.

3. The processing apparatus according to claim 1 or 2.

8. The notification means displays the first image and the second image, and also displays characteristics of the VR video. The processing device according to claim 7 .

9. The notification means displays the first image and the second image, and also displays a graph showing a time series change in characteristics of the VR video. The processing device according to claim 7 .

10. The determination means determines a frame in the VR video in which the specific symptom is likely to occur in the user, the notifying means notifies the user of a frame section in which the specific symptom is likely to occur, when the determining means determines that the specific symptom is likely to occur in the user. The processing device according to claim 7 .

11. When the determination means determines that the specific symptom may occur in the user and a graph showing a time series change in the characteristics of the VR video is displayed, the notification means highlights a position on the graph corresponding to a frame in which the specific symptom may occur in the user. The processing device according to claim 10 .

12. The characteristics of the VR video include a first characteristic indicating a difference between the first image and the second image, and a second characteristic indicating a degree of movement of an imaging device that captured the VR video.

3. The processing apparatus according to claim 1 or 2.

13. the first characteristic includes at least one of a size misalignment, a position misalignment, a rotation misalignment, a brightness difference, a color difference, a contrast ratio difference, and a parallax difference between the first image and the second image; 13. The processing device according to claim 12.

14. When the VR video is content captured by an imaging device installed in a vehicle, the second characteristic is a yaw angular velocity and a pitch angular velocity of the imaging device, If the VR video is content shot while camera shake is occurring, the second characteristic is the magnitude of the camera shake.

13. The processing device according to claim 12.

15. The specific symptom is at least one of fatigue and VR sickness, 3. The processing apparatus according to claim 1 or 2.

16. an acquisition step of acquiring a VR video including a first image to be displayed to the right eye of a user and a second image to be displayed to the left eye of the user; A determination step of determining the possibility that the user will experience a specific symptom due to watching the VR video, based on information about the content of the VR video, information about the user, and characteristics of the VR video; A processing method comprising the steps of:

17. A program for causing a computer to function as each of the means of the processing device according to claim 1 or 2.

Images