Information processing apparatus, control method, computer program product, and computer-readable storage medium
By displaying images of selected VR content side-by-side on the user's terminal, the problem of users finding it difficult to compare multiple 3D images is solved, enabling fast and fatigue-free image comparison.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- CANON KK
- Filing Date
- 2025-12-19
- Publication Date
- 2026-06-26
Smart Images
Figure CN122284802A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to information processing equipment, control methods, computer program products, and computer-readable storage media. Background Technology
[0002] When booking hotels, users search for hotel options online and make their desired bookings. At this time, users book their desired bookings by referring to two-dimensional information (text and two-dimensional images) displayed on a terminal such as a personal computer or smartphone.
[0003] Wide-angle photography is necessary when displaying images, such as interior views of hotel rooms, as wide as possible on terminals like personal computers or smartphones. Because wide-angle images differ from the actual appearance of the room in terms of perspective and other aspects, it is difficult for users to grasp the true state of the room.
[0004] In contrast, 3D images allow users to acquire information such as the actual depth of a room that cannot be easily obtained from 2D information. However, users who want to compare multiple 3D images must perform complex operations. For example, such a user must stop replaying the image being viewed, then return the screen to full screen to select another image, and then reselect the image the user wants to view. Japanese Patent Publication No. 2020-120411 discloses a method for presenting supplementary content in a virtual reality environment of a head-mounted display without interfering with the visibility of the main content.
[0005] In Japanese Patent Publication No. 2020-120411, the control circuit displays the main content in the foreground area of the user's field of view and additional content in the surrounding area of the foreground area. However, the display method in Japanese Patent Publication No. 2020-120411 is not suitable for comparing the main content. Summary of the Invention
[0006] This disclosure provides a technique for implementing a display suitable for users to compare multiple three-dimensional images.
[0007] The information processing apparatus according to this disclosure includes: a selection unit configured to select at least two VR contents from a plurality of VR contents in response to an operation from a user; and a display control unit configured to control a display unit to display an image of a VR space in which the at least two VR contents selected by the selection unit are arranged side by side, wherein in a first case where the first VR contents and the second VR contents are selected by the selection unit, the display control unit controls the display unit to display an image of a VR space in which a first area for displaying the first VR contents and a second area for displaying the second VR contents are arranged side by side.
[0008] The features of this disclosure will become clear from the following description of embodiments with reference to the accompanying drawings. The following description of embodiments is by way of example. Attached Figure Description
[0009] Figure 1 This is a diagram showing the overall configuration of the reservation system.
[0010] Figure 2A and Figure 2B A display of a user terminal according to the first embodiment is shown.
[0011] Figure 3 This is a flowchart illustrating the operation of the reservation management system according to the first embodiment.
[0012] Figure 4A and Figure 4B The state of displaying VR images according to the first embodiment is shown.
[0013] Figure 5 A non-VR image displayed on a user terminal according to a first embodiment is shown.
[0014] Figure 6A and Figure 6B The state of displaying VR images according to the first embodiment is shown.
[0015] Figure 7A and Figure 7B The state of displaying VR images on a user terminal according to the first embodiment is shown.
[0016] Figure 8A and Figure 8B The state of displaying VR images on a user terminal according to the first embodiment is shown.
[0017] Figure 9 This is a schematic diagram of a VR space viewed in the vertical direction according to the first embodiment.
[0018] Figure 10This is a schematic diagram of a stereo camera used to capture 3D 180-degree images.
[0019] Figure 11 This is a schematic diagram of a VR space viewed in the vertical direction according to the second embodiment.
[0020] Figure 12 This is a schematic diagram of a VR space viewed in the vertical direction according to the second embodiment.
[0021] Figure 13A and Figure 13B This is an explanatory diagram of perspective conflict according to the second embodiment.
[0022] Figure 14 This is an explanatory diagram of the non-display area according to the second embodiment.
[0023] Figure 15A and Figure 15B This is a schematic diagram of a VR space viewed in the vertical direction according to the second embodiment.
[0024] Figure 16A and Figure 16B The state of displaying VR images according to the third embodiment is shown.
[0025] Figure 17A and Figure 17B This is a schematic diagram of a VR space viewed in the vertical direction according to the third embodiment.
[0026] Figure 18A and Figure 18B The state of displaying VR images according to the third embodiment is shown. Detailed Implementation
[0027] First Embodiment
[0028] refer to Figures 1 to 8B The first embodiment will now be described. Figure 1 This is an overall configuration diagram of the reservation system 1 using an information processor according to the first embodiment. The reservation system 1 includes a reservation management system 11, a content server 12, and a user terminal 16.
[0029] In a first embodiment, the reservation management system 11 is used to allow users to reserve accommodation options. The reservation management system 11 obtains images (VR images) of service content such as interior views of rooms, accommodation facilities, and meals in the VR (virtual reality) space from the content server 12. In response to a selection operation performed by a user on a user terminal 16, the reservation management system 11 sends the selected option and the VR image associated with that option to the user terminal 16.
[0030] The reservation management system 11 includes an accommodation plan database (DB) 111, a reservation information database (DB) 112, a control unit 113, a display control unit 114, an acquisition unit 115, a notification unit 116, and a selection unit 117.
[0031] The accommodation plan database 111 is a database that includes storage units such as storage media. These storage units store information, for example, about the accommodation plans to be presented to the user. For each accommodation plan, the accommodation plan database 111 contains information about room availability (information about whether the plan can be booked), price information, information about the room's interior view and accommodation facilities, and information about services such as meals. The various information stored in the accommodation plan database 111 may include two-dimensional images, etc. The various information stored in the accommodation plan database 111 is stored by the accommodation facility 13 and the travel agency 14. The reservation management system 11, in response to user operations on the user terminal 16, sends information about bookable plans from the accommodation plan database 111 to the user terminal 16.
[0032] The reservation information DB 112 is a database that includes storage units such as storage media. The storage units are used, for example, to store reservation information about the selected accommodation in response to a reservation operation performed by a user on user terminal 16. The reservation information includes the user's personal information (contact information), information about the reserved accommodation (referred to as "accommodation information"), and information about the surrounding area related to the reserved accommodation (referred to as "surrounding area information").
[0033] The plan information includes details such as the accommodation facilities, room, date, time slot, price, and services included in the plan (e.g., food). Each piece of information in the plan information is associated with multiple VR or non-VR images.
[0034] The surrounding information includes various pieces of information such as tourist information about the vicinity of the accommodation, directions to the accommodation, and transportation methods to the accommodation. These pieces of information are not directly related to the accommodation plan but are useful to the user. One or more relevant images (VR or non-VR images) are associated with each piece of information.
[0035] Control unit 113 controls the entire reservation management system 11. In response to user operations on user terminal 16, control unit 113 stores reservation information in reservation information DB 112. Control unit 113 also determines the content to be displayed on user terminal 16 and performs user authentication, etc. Control unit 113 obtains information about the type of the user terminal 16 (terminal type information) from user terminal 16 to determine the type of user terminal 16 based on the terminal type information. The terminal type is a type corresponding to the terminal itself, such as HMD, smartphone, or PC.
[0036] The display control unit 114 responds to user operations on the user terminal 16 by displaying VR images (VR content) or non-VR images (non-VR content) on the user terminal 16. The display control unit 114 sends VR images or non-VR images from the accommodation solution DB 111 or the content server 12 to the user terminal 16. The display control unit 114 can control the user terminal 16 to display non-VR images overlaid on VR images.
[0037] The acquisition unit 115 acquires VR images or non-VR images in response to user operations on the user terminal 16. For example, the acquisition unit 115 acquires VR images or non-VR images from the accommodation scheme DB 111 and the content server 12.
[0038] Notification unit 116 provides, for example, a reservation confirmation notification to the user's registered contact address and accommodation facility 13 (or travel agency 14) via email. After the reservation is made, notification unit 116 may provide a notification based on the reservation information to encourage the user to store the VR image on content server 12.
[0039] Selection unit 117 accepts user input during the comparison display process described later. Furthermore, in the comparison display process, selection unit 117 selects at least two VR images from a plurality of VR images in response to the user input. However, the VR images selected by selection unit 117 are not limited to the images corresponding to the user input. For example, selection unit 117 automatically selects a user-related scheme based on the user's scheme selection history, scheme information, or surrounding information. Additionally, selection unit 117 may instruct acquisition unit 115 to acquire the VR image corresponding to the selected scheme.
[0040] Content server 12 is a server that includes storage units such as storage media. Within these storage units, information about the interior views and facilities of the accommodation rooms, as well as service content such as meals, is stored. The various information stored on content server 12 can include non-VR images and 3D stereoscopic images. 3D stereoscopic images are stereoscopic images that include images stored as both 3D and 180-degree views (3D 180-degree images) and images stored as both 3D and 360-degree views (3D 360-degree images). Information on content server 12 can be stored by the person in charge of the accommodation facility 13 or by one or more photographers.
[0041] The 3D 180-degree and 3D 360-degree images in the first embodiment are obtained by capturing real space using a camera (stereo camera) with multiple parallelly arranged fisheye lenses. A 3D 180-degree image is a type of three-dimensional image obtained by capturing space from in front of the camera at a horizontal viewing angle of approximately 180 degrees. A 3D 360-degree image is a type of three-dimensional image in 360-degree space. Both 3D 180-degree and 3D 360-degree images consist of two images each with parallax. One image corresponds to the user's right eye, and the other to the user's left eye. The user observes the 3D 180-degree and 3D 360-degree images, which have undergone predetermined processing using image editing software, etc., through a compatible HMD. This provides the user with a three-dimensional view of objects, thus creating an immersive viewing experience.
[0042] Generally, it is assumed that the effective field of view that a human can consciously observe at one time is approximately 60 to 70 degrees in the forward horizontal direction. In the first embodiment, an image larger than this range is referred to as a 3D 180-degree image. An image captured within a horizontal range of 60 degrees or less and within a range (view of view) forming a relatively narrow angle relative to a 3D 180-degree image is referred to as a 3D narrow-angle image. However, a 3D 180-degree image is not strictly limited to an image with a horizontal view of approximately 180 degrees. For example, an image can have a horizontal view of 190 degrees, 220 degrees, 140 degrees, or 90 degrees. Using a head-mounted display (HMD), by moving the head or line of sight, a user can observe an area of the image captured as a 3D 180-degree image or a 3D 360-degree image that is larger than the effective field of view.
[0043] Users can be allowed to observe one of two images captured as a 3D 180-degree image or a 3D 360-degree image, exhibiting parallax. One of the two images with parallax can be a 2D image as a 180-degree image (2D 180-degree image) or a 2D image as a 360-degree image (2D 360-degree image). When observing 2D 180-degree and 2D 360-degree images using an HMD, users do not experience a stereoscopic effect but can still perceive their surroundings. When observing 2D 180-degree and 2D 360-degree images on a terminal displaying 2D images, such as a personal computer or smartphone, users can change their viewpoint through user interaction. In this case, users do not experience immersion. However, in this scenario, the amount of information the user derives from the image is increased compared to a simple 2D image.
[0044] In the first embodiment, 3D 180-degree images, 3D 360-degree images, 3D narrow-angle images, 2D 180-degree images, and 2D 360-degree images are collectively referred to as VR images. VR images can be static images or moving images. Because VR images contain a large amount of information compared to simple two-dimensional images, network bandwidth may be compressed when downloading VR images to user terminal 16. Therefore, it is necessary to send VR images to the appropriate recipients at appropriate timings.
[0045] The VR images to be stored on content server 12 are not always stored by the person in charge of accommodation facility 13. VR images can be stored on content server 12 by one or more photographers 151 and 152. For example, photographers 151 and 152 could be guests of accommodation facility 13, and VR images of the meals and interior views of the rooms actually occupied by photographers 151 and 152 could be stored in association with the booking scheme. As described above, the personnel storing VR images on content server 12 are not limited to the person in charge of accommodation facility 13. Therefore, even when the person in charge of accommodation facility 13 does not take VR images of the facility, it is expected that high-quality VR images can be obtained from multiple guests with a high level of VR image appreciation.
[0046] User terminal 16 can be connected to reservation management system 11 via a network such as the Internet and has a display unit. In the first embodiment, user terminal 16 includes personal computer 161 and smartphone 162, which are capable of displaying two-dimensional images, and HMD 163, which is capable of displaying three-dimensional VR images, which are connected to reservation management system 11. However, user terminal 16 can be any terminal if it can connect to a network, display images, and perform user operations.
[0047] When connected to the reservation management system 11, the user terminal 16 sends terminal type information and other data to the reservation management system 11. The reservation management system 11 receives the terminal type information and identification information (described later) sent from the user terminal 16. Based on the operation of the user terminal 16, the reservation management system 11 changes the image format to be displayed on the user terminal 16. The user terminal 16 displays the non-VR or VR image sent from the reservation management system 11 on the display unit.
[0048] refer to Figures 2A to 8B The following describes the process of users making reservations using HMD 163 (user terminal 16). Figure 2A and Figure 2B The display of HMD 163 is shown. Figure 2A In the image, a user wearing an HMD 163 is observing the screen displayed on the HMD 163. Figure 2A In the image, box 201, indicated by a dashed line, shows the visible range for the user wearing HMD 163. Search page 202 displays multiple accommodation options for the user. Non-VR images are displayed on the search page 202 to indicate the location of accommodations on a map. Search page 202 is displayed on the display unit when the user is using personal computer 161 or smartphone 162.
[0049] Figure 3 This is a flowchart illustrating the operation of the reservation management system 11 when a user uses the HMD 163 reservation scheme. The flowchart begins with "the user accesses the reservation management system 11 using HMD 163 and enters information such as accommodation date and time, number of guests, and accommodation location while viewing the search page 202".
[0050] In S301, control unit 113 searches the accommodation scheme DB 111 for options that meet the search criteria. Display control unit 114 causes HMD 163 to display the search results performed by control unit 113 from accommodation scheme DB 111. The search results displayed on HMD 163 can be, for example, two-dimensional information indicating the content of the main scheme (price, scheme name, etc.) and simultaneously indicating the locations of candidate accommodation facilities on a map. When the search results are displayed, the user performs a user operation (selection operation) to select one of the multiple displayed schemes (search results) that closely matches the desired criteria.
[0051] In S302, the control unit 113 selects the scheme corresponding to the selection operation.
[0052] In S303, the display control unit 114 causes the HMD 163 to display detailed information about the scheme selected in S302. For example... Figure 2BAs shown, HMD 163 displays a detailed screen 203 as two-dimensional information showing various information about the scheme selected through the selection operation.
[0053] Detailed screen 203 includes information such as room and bed dimensions for the selected option in S302. Detailed screen 203 includes two-dimensional thumbnails 204 and 205, price information 206, and a reservation button 207. Two-dimensional thumbnail 204 shows an interior view of the room. Two-dimensional thumbnail 205 shows views from the room, the dining area, the outdoor bath, etc. The reservation button 207 is used to request a reservation. Assume the user selects two-dimensional thumbnail 204 to obtain detailed information about the interior view of the room for the selected option.
[0054] In S304, the display control unit 114 causes the HMD 163 to display the VR image corresponding to the two-dimensional thumbnail 204. To this end, when a user operation selecting the two-dimensional thumbnail 204 is detected, the control unit 113 first obtains terminal type information. The display control unit 114 sends an image in an image format corresponding to the terminal type information (terminal) to the user terminal 16. In the first embodiment, since the user accesses the reservation management system 11 using the HMD 163, the display control unit 114 sends a VR image of the room's interior view from the content server 12 to the HMD 163. Therefore, the display control unit 114 controls the display unit of the HMD 163 to display the VR image of the room's interior view. This allows the user to confirm the VR image using the HMD 163.
[0055] VR image formats include 3D 180-degree images, 3D 360-degree images, 2D 180-degree images, and 2D 360-degree images. In the first embodiment, it is assumed that the 3D 180-degree image is associated with a scheme selected by the user.
[0056] Figure 4A and Figure 4B This shows the status of a VR image displaying an interior view of a room on an HMD 163. Figure 4A and Figure 4B In the diagram, the box 401, indicated by the dashed line, represents the field of view of the HMD 163, the user's viewing range within the VR image. On the HMD 163, the range displayed in the VR image is altered by moving the box 401 according to the user's head movement. For example, when observing... Figure 4A When the user of the image in box 401 shown turns their head to the left, as Figure 4B The extent of the VR image displayed is altered as shown. In the first embodiment, the VR image displayed on the HMD 163 is a 3D 180-degree image, allowing the user to feel as if he or she is looking around the room.
[0057] The display control unit 114 can display a non-VR image corresponding to the selected plan based on the selection operation, such that the non-VR image is overlaid on the VR image displayed on the HMD 163. In the first embodiment, price information 403, a reservation button 404, and a registration button 405 are displayed so as to be overlaid on the VR image of the room's interior view. Price information 403 indicates price information for the selected plan. The reservation button 404 is a button for requesting a reservation for the selected plan. The registration button 405 is a button for registering the selected plan as a favorite for later comparison with other plans. Price information 403, reservation button 404, and registration button 405 are collectively referred to as overlaid two-dimensional information 402. When the selected plan is not registered as a favorite, the registration button 405 is displayed as, for example, an empty asterisk. When the selected plan is registered as a favorite, the registration button 405 is displayed as, for example, a black asterisk.
[0058] To improve visibility, the overlaid 2D information 402 is preferably displayed as an overlay on a position closer to the user than the VR image (a position closer to the user). For example, the overlaid 2D information 402 is displayed at a virtual location 40cm away from the user. Furthermore, the 3D 180-degree image of the room's interior is preferably imaged such that the nearest object is placed at a distance of 50cm or more from the user.
[0059] In S305, control unit 113 determines whether the user has performed an operation to select another option (a different option from the one selected in S302) (referred to as an "other option selection operation"). When it is determined that the user has performed an other option selection operation, control unit 113 returns processing to S304. When it is determined that the user has not performed an other option selection operation, control unit 113 advances processing to S306. The user can register the option displayed by the other option selection operation as a favorite by using registration button 405.
[0060] In S306, control unit 113 determines whether the user has performed a user operation (referred to as a "confirmation operation") to confirm various information corresponding to the scheme selected in S305. When it is determined that the user has performed a confirmation operation, control unit 113 returns processing to S303. When it is determined that the user has not performed a confirmation operation, control unit 113 advances processing to S307.
[0061] In S307, the display control unit 114 determines whether the user has performed an operation (referred to as a "comparison operation") to select a mode for comparing schemes registered as favorites (scheme comparison mode). When it is determined that the user has performed a comparison operation, the display control unit 114 advances the process to S308. When it is determined that the user has not performed a comparison operation, the display control unit 114 advances the process to S309. In the first embodiment, the process performed by the display control unit 114 in scheme comparison mode is referred to as comparison display processing. When a comparison operation cannot be performed (e.g., when the user has only registered one scheme as favorites), the display control unit 114 may advance the process to S309.
[0062] In S308, the display control unit 114 performs comparison display processing. (Refer to...) Figures 6A to 8B The comparison display process is described below. In the comparison display process, the display control unit 114 causes the HMD 163 to display a thumbnail group 601. The thumbnail group 601 is a group of two-dimensional thumbnail images corresponding to multiple schemes (multiple VR images associated with the schemes) registered as favorites by the user. The display control unit 114 displays an image in VR space arranged with at least two VR images selected by the selection unit 117. Figure 6A The diagram shows the state in which thumbnail group 601 is displayed on HMD 163. On HMD 163, thumbnail group 601 is displayed at the top of the user's field of view in the horizontal direction (at the top of the user's field of view).
[0063] The display control unit 114 changes the position of frame 401 as the user moves his or her head in the horizontal direction (lateral direction). Even as the position of frame 401 changes, the display control unit 114 performs control to display thumbnail group 601 in front of the user's line of sight in response to the user's movement of looking up at thumbnail group 601.
[0064] The display control unit 114 controls the display unit of the HMD 163 during the comparison display process to display an image of the VR space. In this case, two areas are arranged horizontally in the space surrounding the user in the VR space. On the HMD 163, a first area 610 deployed on the right and a second area 620 deployed on the left are displayed side by side relative to the user facing forward. Figures 6A to 8BFor convenience, the first region 610 and the second region 620 are shown as obscured strips in a vertical view, but in reality, the display area, as a combination of the first region 610 and the second region 620, has a hemispherical dome shape. Furthermore, when viewing the VR space vertically, the first region 610 and the second region 620 are displayed as separate 180-degree ranges around the user's position. In the first embodiment, the images in the VR space, i.e., the images displayed in the first region 610 and the second region 620, have the same size and the same projected size. This disclosure is not limited thereto.
[0065] When viewed from the user's perspective in VR space, the first region 610 and the second region 620 are formed into a hemispherical dome shape to cover a 360-degree circumference in the horizontal direction. The display area is formed into a hemispherical dome shape, allowing the user to experience immersion by observing the VR images displayed in the first region 610 and the second region 620.
[0066] The operation of selection unit 117 in the comparison display process will now be described. Selection unit 117 selects at least two VR images from multiple VR images associated with multiple schemes in response to an operation performed by the user when comparing schemes. In scheme comparison mode, the user first selects a scheme to compare from thumbnail group 601. Figure 6B As shown, the user drags and drops a thumbnail 601a indicating the scheme to be compared from thumbnail group 601 onto the first area 610 via gestures or a controller connected to the HMD 163. In response to this user operation (drag and drop), selection unit 117 selects a first VR image (a 3D 180-degree image associated with thumbnail 601a). Display control unit 114 displays the VR image selected by selection unit 117 on the display unit (first area 610) of the HMD 163.
[0067] As a comparison target for the scheme shown in thumbnail 601a, the user selects a thumbnail image showing a scheme different from the scheme shown in thumbnail 601a. Here, it is assumed that the user has dragged and dropped thumbnail 601b onto the second area 620 via gestures or a controller connected to HMD 163. Selection unit 117 selects a second VR image (a 3D 180-degree image associated with thumbnail 601b) in response to this user operation. Display control unit 114 displays the VR image selected by selection unit 117 on the display unit (second area 620) of HMD 163. For example, when a scheme is registered as a favorite, selection unit 117 determines that the number of comparable schemes is no greater than a threshold and can automatically select a scheme different from the scheme registered as a favorite as a comparison target. For example, when only the scheme shown in thumbnail 601a is registered as a favorite, selection unit 117 can automatically select the scheme to be compared with the scheme shown in thumbnail 601a.
[0068] exist Figure 7A and Figure 7B In the first region 610, image 700a, as a 3D 180-degree image associated with thumbnail 601a, is displayed. In the second region 620, image 700b, as a 3D 180-degree image associated with thumbnail 601b, is displayed. Figure 7A As shown, when a user views the image in the direction of the first region 610, the display control unit 114 displays enhanced edges of thumbnail 601a included in thumbnail group 601. This indicates that image 700a is associated with thumbnail 601a.
[0069] The display control unit 114 determines the superimposed two-dimensional information 402 corresponding to the content of the image 700a. The display control unit 114 displays the determined superimposed two-dimensional information 402, such that the two-dimensional information 402 is superimposed on the image 700a in the field of view of the HMD 163 and in the first region 610. Since the scheme associated with the thumbnail 601a has been registered as a favorite, the registration button 405 provides a display showing the registration (black asterisk).
[0070] In the following description, it is assumed that a user wishes to unregister the collection scheme associated with thumbnail 601a and exclude that scheme from the comparison targets. If the user in Figure 7A If the registration button 405 is selected in the state shown, the display control unit 114 will switch the display of the registration button 405 to indicate that registration has been cancelled (hollow asterisk, not shown). Thumbnail 601a is removed from thumbnail group 601.
[0071] like Figure 7BAs shown, when the user faces the direction of the second region 620, the display control unit 114 cancels the edge enhancement of thumbnail 601a and displays the enhanced edges of thumbnail 601b. This indicates that image 700b is associated with thumbnail 601b. In the first embodiment, the display control unit 114 displays thumbnails 601c and 601d (not shown in the first region 610 or the second region 620) in a smaller size and lighter color than thumbnails 601a and 601b. Therefore, the displayed thumbnails 601c and 601d indicate that the VR image associated with thumbnail 601c and the VR image associated with thumbnail 601d are not displayed on the display unit of HMD 163. When the user faces the direction of the second region 620, the display control unit 114 determines the overlaid two-dimensional information 402 corresponding to the content of image 700b. The display control unit 114 displays the determined superimposed two-dimensional information 402, such that the two-dimensional information 402 is superimposed on the image 700b in the field of view of the HMD 163 and in the second region 620.
[0072] refer to Figure 8A and Figure 8B The following describes the scenario where the user changes the content displayed in the first area 610. When the user drags and drops thumbnail 601c from thumbnail group 601 onto the first area 610, selection unit 117 accepts the user's operation. In response to this user operation, selection unit 117 selects image 800 (a 3D 180-degree image associated with thumbnail 601c) as the VR image to be replaced by image 700a. Display control unit 114 displays image 800 (VR image) selected by selection unit 117 on the display unit (first area 610) of HMD 163. Display control unit 114 enhances the edges of thumbnail 601c in thumbnail group 601 and changes thumbnail 601c to the same size as thumbnail 601b. Display control unit 114 cancels the edge enhancement of the replaced thumbnail 601a and changes the display of thumbnail 601a to a smaller size and lighter color. In addition, the display control unit 114 changes the content of the superimposed two-dimensional information 402 to information about the scheme associated with the thumbnail 601c.
[0073] In the scheme comparison mode, users can compare two schemes while simultaneously using head navigation to confirm the room's interior, furniture, area, and price. When images 800 and 700b are displayed, if the user determines that the scheme in image 800 (thumbnail 601c) is the preferred option, then the user selects it. Figure 8B The reservation button 404 shown enables the reservation operation of the scheme of image 800.
[0074] Return to Figure 3As described, in step S309, the control unit 113 determines whether the user has performed a user operation (reservation operation) to reserve the selected plan. When it is determined that the user has performed a reservation operation, the control unit 113 proceeds to S310. When it is determined that the user has not yet performed a reservation operation, the control unit 113 waits for a reservation operation. When the user selects the reservation button 404, the HMD 163 displays the application screen (not shown) for the selected plan. The application screen consists of two-dimensional information. After additionally entering personal information and payment information about the user on the application screen, the reservation is confirmed on the final confirmation screen to sign the contract.
[0075] In S310, the control unit 113 stores reservation information based on user operations on the HMD 163 in the reservation information DB 112. The reservation information is information associated with the user's personal information, identification information, plan information, and surrounding information (information containing each of these pieces of information).
[0076] In the following text, it is assumed that the user uses a user terminal 16, such as a personal computer 161 or a smartphone 162, which can only provide two-dimensional display. The display control unit 114 controls the user terminal 16 to display a non-VR image of the room's interior, allowing confirmation of the user's selected plan, based on terminal type information. If both the VR image and the non-VR image are stored in the accommodation plan DB 111 or the content server 12, the display control unit 114 can send either the VR image or the non-VR image to the user terminal 16, depending on the terminal type information. When the user selects a two-dimensional thumbnail 204, the display control unit 114 sends a non-VR image corresponding to the interior view of the room for the user-selected plan to the user terminal 16.
[0077] Figure 5This illustration shows a state where a non-VR image representing an interior view of a room is displayed on the display unit of a personal computer 161 or smartphone 162. On the display unit, price information 501, a reservation button 502, and a registration button 503 are displayed as two-dimensional information. Price information 501 indicates the price information for the selected plan. The reservation button 502 is a button for making a reservation for the selected plan. The registration button 503 is a button for registering the selected plan as a favorite plan so that the user can later compare it with another plan. All the two-dimensional information is displayed without overlaying the non-VR image corresponding to the interior view of the room. Furthermore, a two-dimensional thumbnail 504 is displayed to facilitate comparison between the selected plan and another plan. The two-dimensional thumbnail 504 is a thumbnail image of an image corresponding to the interior view of the room for another plan. The two-dimensional thumbnail 504 is displayed without overlaying the non-VR image corresponding to the interior view of the room. By selecting the two-dimensional thumbnail 504, the user can view the image corresponding to the other plan. The process prior to appointment confirmation is the same as when viewing VR images on the HMD 163, so its description is omitted. The appointment information associated with the appointment details records the appointment actions performed by the user when viewing non-VR images.
[0078] Return to Figure 3 In step S311, notification unit 116 notifies the user's registered contact address of the reservation confirmation via email or the like based on the reservation information. Furthermore, notification unit 116 notifies the accommodation facility 13 or travel agency 14 of the reservation confirmation via email or the like based on the reservation information. The email contains a link (URL) to the reservation information, allowing the user to confirm the reservation details by selecting the link.
[0079] As described above, the display control unit 114 divides the 360-degree area around the user into two distinct zones in the VR space, displaying a single 3D 180-degree image in one zone and a different 3D 180-degree image in the other. This allows the display control unit 114 to display two 3D 180-degree images surrounding the user. Therefore, the user can compare the two rooms simply by turning their head, without needing to perform a screen switching operation. Furthermore, since the user can compare the two rooms simply by turning their head, comparisons can be made quickly without any time lag. In the first embodiment, the two 3D 180-degree images displayed on the HMD 163 are VR images with the same size and projection size, extending in the depth direction. This reduces sudden convergence and divergence eye movements during comparison, thereby alleviating eye fatigue.
[0080] In the first embodiment, the display control unit 114 displays an image of the VR space, wherein 3D 180-degree images associated with two different scenarios are arranged horizontally. In this case, the two 3D 180-degree images arranged in the VR space do not need to be 3D 180-degree images associated with two different scenarios. For example, the two 3D 180-degree images arranged in the VR space may be associated with the same scenario, but could also be VR images obtained by capturing the real space at different times, such as day and night. The two 3D 180-degree images arranged in the VR space could also be VR images obtained by capturing the real space from different locations.
[0081] Furthermore, the VR image displayed on the HMD 163 by the display control unit 114 is not limited to a 3D 180-degree image, but can also be, for example, a 2D 180-degree image. When the VR image displayed on the HMD 163 by the display control unit 114 is a 3D 360-degree image or a 2D 360-degree image, the display control unit 114 can display a portion of each VR image. When the VR image displayed in the first area 610 and the second area 620 is a 3D narrow-angle image with a small viewing angle, the first area 610 and the second area 620 do not need to have a hemispherical dome shape. For example, the display control unit 114 can display an image of two planar display areas arranged in a horizontal (lateral) VR space when viewed from the user's perspective.
[0082] Furthermore, the VR images selected by selection unit 117 are not limited to VR images related to the accommodation program or VR images of rooms in the accommodation facility. For example, selection unit 117 can select VR images that are classified into the same category from the content of VR images requested by the user. For example, when the VR images displayed on HMD 163 are images categorized as the user's "experience activities," display control unit 114 can perform control to arrange VR images of ski resorts and VR images of surfing venues.
[0083] Furthermore, in the first embodiment, the display control unit 114 arranges two 3D 180-degree images associated with the two schemes. However, the number of VR images that can be arranged is not limited to two, and can be three or more. In the first embodiment, the thumbnail group 601 is displayed without overlapping with the schemes. However, for example, if many schemes are the targets of comparison, then the thumbnail group 601 is displayed as overlapping thumbnail images to save display area. Even if the thumbnail images are displayed as overlapping each other, the image that the user has selected and the image that the user wants to select are preferably displayed without overlapping each other.
[0084] Second Embodiment
[0085] The following will be referenced Figures 9 to 15BThe second embodiment is described. Descriptions of configurations identical to those in the first embodiment are omitted. In the second embodiment, during the comparison display process, the display control unit 114 displays at least two VR images arranged within a 360-degree VR space surrounding the user.
[0086] Figure 9 This is a schematic diagram of the VR space displayed by the display control unit 114 in the first embodiment, which is viewed in the vertical direction. Image 700a is displayed in the first region 610 and image 700b is displayed in the second region 620. Range 910 shows the range of the first region 610 in the VR space (the display range of image 700a), and range 920 shows the range of the second region 620 in the VR space (the display range of image 700b). Two adjacent boundary portions of the first region 610 and the second region 620 are represented as boundary portions 930a and 930b.
[0087] The features of a 3D 180-degree image will be described below. Figure 10 This is a schematic diagram of a stereo camera used to capture 3D 180-degree images. Cameras 1000a and 1000b are cameras with fisheye lenses capable of imaging from the same angle of view (ideally capable of imaging a real space with a horizontal angle of view of 180 degrees or greater). Cameras 1000a and 1000b are positioned separately at a predetermined distance. The predetermined distance can be approximately 64 to 65 mm, which is the average distance between the pupils of the human eye. In the following text, it is assumed that an object is located near the front of both cameras, as if object 1010a were positioned relative to cameras 1000a and 1000b. When object 1010a is captured by both cameras 1000a and 1000b simultaneously, a convergence angle 1020a is formed by the imaging directions of camera 1000a and camera 1000b, allowing images of the two objects with parallax to be obtained.
[0088] The user uses the HMD 163 to recognize images captured by the right camera 1000a using right-eye vision and images captured by the left camera 1000b using left-eye vision. This allows the user to have a stereoscopic view of objects and feel as if the user is part of the scene.
[0089] In the following text, it is assumed that the object is located at a considerable distance in front of the two cameras, such as the position of object 1010b relative to cameras 1000a and 1000b. In this case, the convergence angle 1020b is small, and the parallax between the object image captured by camera 1000a and the object image captured by camera 1000b is reduced. Therefore, cameras 1000a and 1000b can only capture the same image. When the parallax of the VR image (3D 180-degree image) is small, it is difficult for the user to obtain a stereoscopic effect. Furthermore, the stereoscopic effect obtained by the user deteriorates from the peak in the central part of the image to the peripheral parts. In this way, the 3D 180-degree image has a region near the center of the image that the user who captured the image can obtain a stereoscopic effect (hereinafter referred to as the "central region").
[0090] Return to Figure 9 The first central region 911 is the region within the first region 610 that allows the user to obtain the maximum stereoscopic effect. The second central region 921 is the region within the second region 620 that allows the user to obtain the maximum stereoscopic effect. The first central axis 912 is the central axis of the first central region and is a straight line connecting the position of the user wearing the HMD 163 to the center of the first region 610. The second central axis 922 is the central axis of the second central region and is a straight line connecting the position of the user wearing the HMD 163 to the center of the second region 620. Figure 9 In the arrangement of the 3D 180-degree image (first embodiment) shown, the angle formed by the first central axis 912 and the second central axis 922 is approximately 180 degrees.
[0091] Figure 11 and Figure 12 This is a schematic diagram of the VR space displayed by the display control unit 114 in the vertical direction, as seen in the second embodiment. In the second embodiment, the display control unit 114 positions the first region 610 and the second region 620 such that the angle 1100 formed by the first central axis 912 and the second central axis 922 is less than 180 degrees. By positioning the first region 610 and the second region 620 in this way, the user can reduce the angle at which he / she turns his / her head when comparing two VR images, thereby reducing user fatigue. Figure 11 This illustrates a state where the angle formed by the first central axis 912 and the second central axis 922 is approximately 90 degrees. Figure 11 In the state shown, the display range indicated by ranges 910 and 920 is narrower than the imaging range (180 degrees) of the 3D 180-degree image. Therefore, by setting the angle 1100 formed by the first central axis 912 and the second central axis 922 to 60 degrees or greater, the hidden range in the 3D 180-degree image can be reduced.
[0092] The display control unit 114 can accept user operations for moving the horizontal position of the first central region 911 (the horizontal position of image 700a) and the horizontal position of the second central region 921 in the second region 620 (the horizontal position of image 700b). Therefore, as Figure 12 As shown, the user can confirm the hidden area in the 3D 180-degree image. Furthermore, the user can set the positions of the first center region 911 and the second center region 921 to suit their posture, thereby facilitating comparison. However, the display control unit 114 does not need to accept such user input. For example, the reservation management system 11 may also include a position determination unit as a component for determining the display position, and this position determination unit can accept user input. Furthermore, the position determination unit can automatically determine a suitable position for displaying images 700a and 700b based on the user's posture.
[0093] Because different 3D 180-degree images are adjacent to each other at boundary portions 930a and 930b, which are the boundary portions between the first region 610 and the second region 620, perspective conflict is likely to occur. (Reference) Figure 13A The following will describe perspective conflict. Figure 13A A 3D 180-degree image, displayed as a two-dimensional image in the first region 610 and the second region 620, is schematically shown. A window frame and sky 1300, observable remotely from the user, are displayed in a portion along the boundary 930a of the first region 610, and room walls 1310 are displayed in a portion along the boundary 930a of the second region 620. Figure 13A In this scenario, suppose wall 1310 is closer to the user's view than sky 1300. However, from the user's perspective, wall 1310 might appear to be hidden behind sky 1300. In this way, when the perspective relationship between objects and space in VR space appears inconsistent with that in real space, the quality of the stereoscopic view is severely compromised. This inconsistency between perspective in VR space and positional relationships in real space is called perspective conflict.
[0094] To reduce discomfort caused by perspective distortion, such as Figure 13B As shown, a non-display area 1320 for hiding VR images can be deployed between the first area 610 and the second area 620. Furthermore, the distance between the user in the stereoscopic view and the non-display area 1320 is preferably set to be less than a predetermined distance.
[0095] Figure 14This is a schematic diagram of the VR space as viewed vertically. The non-display area 1320 in the VR space will be described below. In the second embodiment, the display control unit 114 displays a VR image on the display unit of the HMD 163, wherein a black, prism-shaped virtual object is arranged as the non-display area 1320 in the VR space. The position where the display control unit 114 places the non-display area 1320 (the black virtual object) in the VR space will be described below. Generally speaking, it can be said that clear human vision of an object requires a distance of at least approximately 25 cm between the human eye and the object. Therefore, the display control unit 114 preferably determines the position of the non-display area 1320 at a distance greater than 25 cm from the user's perspective and closer to the user than the object shown in the 3D 180-degree image. Therefore, the distance from the user to the non-display area 1320 is preferably approximately 50 cm. However, the virtual object placed as the non-display area is not limited to a black prism shape. The virtual object can be any object, as long as it can occlude a portion of the first region 610 and a portion of the second region 620 (the boundary portion between the first region 610 and the second region 620).
[0096] In the second embodiment, the case where the distance from the user to the non-display area 1320 is 50cm will be described below. Figure 14 The edge 1420 shown is the edge of one end of the non-display area 1320 when the VR space is viewed in the vertical direction. Figure 14 The edge 1430 shown is the edge at the other end of the non-display area 1320 when the VR space is viewed in the vertical direction. When the VR space is viewed in the vertical direction, the angle 1400 formed by the straight line connecting edge 1420 and the user and the straight line connecting edge 1430 and the user is preferably at least 8 degrees and not more than 30 degrees.
[0097] like Figure 14 As shown, when viewing the VR space vertically, the width of the non-display area 1320 is preferably greater than approximately 65mm (this is the distance between a human's left and right eyes at a point 50cm in front of the user). Therefore, the display control unit 114 can determine the width of the non-display area 1320 to set the angle 1400 to 8 degrees or greater. Since the display control unit 114 determines the width of the non-display area 1320 to set the angle 1400 to 8 degrees or greater, there is no need to display the edges of the non-display area 1320, thereby simplifying image processing. Preferably, the width of the non-display area 1320 should not be too large to avoid obstructing the human's effective field of view. Therefore, the display control unit 114 preferably determines the width of the non-display area 1320 such that the angle 1400 is 30 degrees or less.
[0098] The display control unit 114 can display the boundary between the non-display area 1320 and the first area 610 and the second area 620 in a shadow manner by blurring the edges 1420 and 1430 of the non-display area 1320. This can reduce user discomfort.
[0099] Figure 15A and Figure 15B This is a schematic diagram of a VR space viewed vertically, where non-display areas 1320a and 1320b are placed at corresponding boundary portions between a first area 610 and a second area 620. In non-display area 1320a, angle 1400a is the angle formed by a straight line connecting one end of non-display area 1320a to the user and a straight line connecting the other end of non-display area 1320a to the user. In non-display area 1320b, angle 1400b is the angle formed by a straight line connecting one end of non-display area 1320b to the user and a straight line connecting the other end of non-display area 1320b to the user. For the above reasons, angles 1400a and 1400b are preferably at least 8 degrees and no more than 30 degrees. Figure 15A This is a schematic diagram of VR space when the angle formed by the first central axis 912 and the second central axis 922 is approximately 180 degrees. Figure 15B This is a schematic diagram of VR space when the angle formed by the first central axis 912 and the second central axis 922 is less than 180 degrees. Figure 15B In the case of non-display areas 1320a and 1320b, such as Figure 15A The arrangement is shown in the diagram. The non-display area 1320b (one of two non-display areas) is placed within the area 1500 (the area displayed as black on the display unit) where no 3D 180-degree image is displayed. In this configuration, when viewing the VR space vertically, an angle range of 30 degrees or more in the horizontal direction can be displayed as a black area on the display unit.
[0100] In the second embodiment, when a VR image is displayed with the first region 610 and the second region 620 arranged horizontally, non-display regions 1320a and 1320b are arranged on the boundary between the first region 610 and the second region 620. Therefore, objects included in the VR image displayed in the first region 610 and the second region 620 are obstructed and blocked from view. This reduces user discomfort caused by perspective distortion. Since the boundary between the first region 610 and the second region 620 is clear by placing the non-display regions 1320a and 1320b, users can easily compare different options.
[0101] Third Embodiment
[0102] refer to Figures 16A to 18BThe third embodiment will now be described. Descriptions of configurations identical to those in the first and second embodiments are omitted. In the third embodiment, as in the first and second embodiments, the display control unit 114 displays an image of a VR space with at least two VR images arranged in the comparison display process.
[0103] Figure 16A and Figure 16B This indicates that the user has selected the scheme comparison mode. The space extending horizontally at a 180-degree viewing angle includes a first region 1610 displayed on the right at a 90-degree horizontal viewing angle when viewed from the user's perspective, and a second region 1620 displayed on the left at a 90-degree horizontal viewing angle.
[0104] In the solution comparison mode, the user first selects a solution to compare. For example... Figure 16B As shown, the user drags and drops a thumbnail 601a indicating the scheme to be compared from thumbnail group 601 onto first area 1610 via gesture or a controller connected to HMD 163. In response to this user operation (drag and drop), selection unit 117 selects a first VR image (a 3D 180-degree image associated with thumbnail 601a). Display control unit 114 displays the VR image selected by selection unit 117 on display unit (first area 1610) of HMD 163. The user then selects a thumbnail image representing the scheme to be compared with the scheme shown in thumbnail 601a. In this case, it is assumed that the user has dragged and dropped thumbnail 601b onto second area 1620 via gesture or a controller connected to HMD 163. In response to this user operation, selection unit 117 selects a second VR image (a 3D 180-degree image associated with thumbnail 601b). The display control unit 114 displays the VR image selected by the selection unit 117 on the display unit (second area 1620) of the HMD 163.
[0105] Figure 17A and Figure 17BThis is a schematic diagram of the VR space displayed by the display control unit 114 when viewed in the vertical direction in the third embodiment. In the third embodiment, the non-display area 1700 is deployed on the boundary between the first area 1610 and the second area 1620. The third embodiment will describe the case where the distance from the user to the non-display area 1700 is 50 cm. Angle 1701 is the angle formed by the straight line connecting one end of the non-display area 1700 to the user and the straight line connecting the other end of the non-display area 1700 to the user. Similar to angle 1400 described above, angle 1701 is preferably at least 8 degrees and not more than 30 degrees. Range 1710 indicates the range of the first area 1610 in the VR space (the display range of the 3D 180-degree image associated with thumbnail 601a). Range 1720 indicates the range of the second area 1620 in the VR space (the display range of the 3D 180-degree image associated with thumbnail 601b). The first central area 1711 is the area in the first area 1610 where the user can obtain the maximum stereoscopic effect. The second central region 1721 is the area within the second region 1620 where the user can obtain the maximum 3D effect. The first central axis 1712 is the central axis of the first central region 1711 and is a straight line connecting the position of the user wearing the HMD 163 to the center of the first region 1610. The second central axis 1722 is the central axis of the second central region 1721 and is a straight line connecting the position of the user wearing the HMD 163 to the center of the second region 1620.
[0106] Figure 18A and Figure 18B This illustrates a state where image 1800a (a 3D 180-degree image associated with thumbnail 601a) is displayed in the first region 1610 and image 1800b (a 3D 180-degree image associated with thumbnail 601b) is displayed in the second region 1620. (As shown) Figure 17A As shown, in the third embodiment, the angle formed by the first central axis 1712 and the second central axis 1722 is 0 degrees, and the first central axis 1712 and the second central axis 1722 are oriented in the same direction. Figure 17A and Figure 18AIn the state shown, when the VR space is viewed vertically, ranges 1710 and 1720 are approximately 90 degrees. Therefore, the image corresponding to 180 degrees of the imaging viewpoints of images 1800a and 1800b is not fully displayed. The range hidden in the image corresponding to 180 degrees of the imaging viewpoint of image 1800a is arranged to overlap with the rear side of image 1800b. The range hidden in the image corresponding to 180 degrees of the imaging viewpoint of image 1800b is arranged to overlap with the rear side of image 1800a. Therefore, the area where the first region 1610 (image 1800a) and the second region 1620 (image 1800b) overlap are called the overlay region. The display control unit 114 determines, in response to a user operation, which portion of image 1800a and a portion of image 1800b should be displayed in the overlay region.
[0107] The display control unit 114 can accept user operations that move the non-display area 1700 in the horizontal direction. However, such user operations may not be accepted by the display control unit 114, but may be accepted by, for example, a component part (position determination unit) for determining the display position.
[0108] When a user performs a movement operation on the non-display area 1700, the display control unit 114 changes the ranges 1710 and 1720. Figure 17B and 18B It shows in Figure 17A and Figure 18A The state shown indicates a user operation that moves the non-display area 1700 to the right. The display control unit 114 shrinks the area 1710 and enlarges the area 1720 for display. Figure 17B This illustrates a state where the user's facial orientation aligns with the orientation of the second central axis 1722. This allows the user to comfortably observe the second central region 1721 of the 3D 180-degree image displayed in the second region 1620. In this case, when the user wants to confirm the 3D 180-degree image displayed in the first region 1610, the non-display area 1700 can be shifted to the left to expand the range of the first region 1610. Therefore, the user can comfortably observe the first central region 1711 of the 3D 180-degree image displayed in the first region 1610 while aligning the orientation of the first central axis 1712 with the orientation of the face.
[0109] Therefore, the display control unit 114 can arrange multiple 3D 180-degree images such that the central axes of the multiple 3D 180-degree images face the same direction (the central areas of the multiple 3D 180-degree images are aligned). Thus, regardless of which 3D 180-degree image the user observes when comparing the images (schemes), the display control unit 114 can display the central area of the 3D 180-degree image in front of the user's line of sight without changing facial orientation. This allows the user to observe multiple 3D 180-degree images without changing facial orientation each time a different 3D 180-degree image is displayed, thereby reducing eye strain.
[0110] Furthermore, in the third embodiment, the display control unit 114 horizontally arranges two 3D 180-degree images associated with the two schemes. However, the number of VR images that can be arranged is not limited to two and can be three or more. The VR images displayed on the display unit of the HMD 163 are not limited to 3D 180-degree images and can be 2D 180-degree images or 3D narrow-angle images. For example, when the displayed VR image is a 3D narrow-angle image, the first area 1610 and the second area 1620 can be shaped into two flat screens arranged in the horizontal direction (lateral direction) when viewed from the user.
[0111] The display control unit 114 can arrange multiple 360-degree images (3D 360-degree images or 2D 360-degree images) so that the images are partially superimposed around the user in a 360-degree radius, and non-display areas can be placed on each boundary. Furthermore, the display control unit 114 can perform controls to move the placed non-display areas and change the image range.
[0112] In the foregoing embodiments, the reservation management system 11 is described as a system that allows users to book accommodation options, but this disclosure is not limited thereto. For example, the reservation management system 11 could be a system that allows users to book tickets for concerts, etc., or a system that allows users to purchase items. In particular, the reservation management system 11 can be used effectively when a user wants to compare multiple VR images. Furthermore, the functional units provided in the reservation management system 11 according to the embodiments can be provided in another information processing device. For example, the user terminal 16 could be an information processing device including a control unit, a display control unit, an acquisition unit, a notification unit, and a selection unit. In this case, the reservation management system 11 could be a server that only includes an accommodation option DB 111 and a reservation information DB 112.
[0113] It should be noted that the various types of control described above can be a process performed by a single piece of hardware (e.g., a processor or circuitry), or other processes. Processes can be shared among multiple pieces of hardware (e.g., multiple processors, multiple circuitry, or a combination of one or more processors and one or more circuitry), thereby performing control of the entire device.
[0114] Furthermore, the processors mentioned above are processors in a broad sense, encompassing both general-purpose and special-purpose processors. Examples of general-purpose processors include central processing units (CPUs), microprocessor units (MPUs), and digital signal processors (DSPs). Examples of special-purpose processors include graphics processing units (GPUs), application-specific integrated circuits (ASICs), and programmable logic devices (PLDs). Examples of PLDs include field-programmable gate arrays (FPGAs) and complex programmable logic devices (CPLDs).
[0115] The above embodiments (including variations) are merely examples. Any configurations obtained by appropriately modifying or changing some configurations of the embodiments within the scope of this disclosure are also included in this disclosure. This disclosure also includes other configurations obtained by appropriately combining various features of the embodiments.
[0116] According to this disclosure, a technique can be provided for implementing a display suitable for a user to compare multiple three-dimensional images.
[0117] Other embodiments
[0118] The embodiments of the present invention can also be implemented by the following method: providing software (including computer program products of computer programs) that performs the functions of the above embodiments to a system or device via a network or various storage media, and the computer (central processing unit (CPU) or microprocessor unit (MPU) of the system or device) reads out and executes the computer program.
[0119] While this disclosure has been described with reference to embodiments, it should be understood that this disclosure is not limited to the disclosed embodiments. The scope of the following claims should be given the broadest interpretation to cover all such modifications and equivalent structures and functions.
Claims
1.An information processing apparatus comprising: a selection unit configured to select at least two VR contents from among a plurality of VR contents in response to an operation from a user; and a display control unit configured to control a display unit so as to display an image of a VR space in which the at least two VR contents selected by the selection unit are arranged side by side, wherein in a first case where a first VR content and a second VR content are selected by the selection unit, the display control unit controls the display unit so as to display an image of the VR space in which a first area for displaying the first VR content and a second area for displaying the second VR content are arranged side by side. 2.The information processing apparatus according to claim 1, wherein the display control unit controls the display unit so as to display an image of the VR space in which the at least two VR contents selected by the selection unit are arranged in a horizontal direction. 3.The information processing apparatus according to claim 1 or 2, wherein the display control unit controls the display unit so as to display a plurality of thumbnail images corresponding to the plurality of VR contents, and the operation is an operation for the user to select any one of the plurality of thumbnail images. 4.The information processing apparatus according to claim 1 or 2, wherein the selection unit selects the at least two VR contents of the same category from among the plurality of VR contents. 5.The information processing apparatus according to claim 1 or 2, wherein the plurality of VR contents are VR contents obtained by capturing a real space at different times. 6.The information processing apparatus according to claim 1 or 2, wherein the plurality of VR contents are VR contents obtained by capturing a real space at different places. 7.The information processing apparatus according to claim 1 or 2, wherein in the first case, the display control unit controls the display unit so that a first non-VR content corresponding to the first VR content is superimposed on the first VR content, and a second non-VR content corresponding to the second VR content is superimposed on the second VR content. 8.The information processing apparatus according to claim 7, wherein in the first case, the display control unit determines the first non-VR content in accordance with details of the first VR content, and determines the second non-VR content in accordance with details of the second VR content. 9.The information processing apparatus according to claim 1 or 2, wherein in a case where the selection unit selects a third VR content while the first VR content and the second VR content are displayed side by side on the display unit, and the display control unit controls the display unit so as to display the third VR content in place of the second VR content in the second area. 10.The information processing apparatus according to claim 1 or 2, wherein in the first case, an angle formed by a straight line connecting a center of the first region and a position of the user and a straight line connecting a center of the second region and the position of the user is less than 180 degrees when the VR space is viewed in a vertical direction. 11.The information processing apparatus according to claim 1 or 2, further comprising a determination unit configured to determine a region to be displayed in the first region of the first VR content and determine a region to be displayed in the second region of the second VR content in the first case. 12.The information processing apparatus according to claim 11, wherein in response to an operation from the user, the determination unit determines the region to be displayed in the first region of the first VR content and the region to be displayed in the second region of the second VR content. 13.The information processing apparatus according to claim 1 or 2, wherein in the VR space in the first case, a non-display region in which no VR content is displayed is placed between the first region and the second region. 14.The information processing apparatus according to claim 13, wherein in the VR space, an angle formed by a straight line connecting one end of the non-display region and a position of the user and a straight line connecting the other end of the non-display region and the position of the user is 8 degrees or more when the VR space is viewed in a vertical direction. 15.The information processing apparatus according to claim 1 or 2, wherein in the VR space in the first case, an overlap region in which the first region and the second region overlap each other is formed. 16.The information processing apparatus according to claim 15, wherein in the first case, the display control unit determines which one of a part of the first VR content and a part of the second VR content is to be displayed in the overlap region in response to an operation from the user. 17.A control method of an information processing apparatus, comprising: a selection step of selecting at least two VR contents from a plurality of VR contents in response to an operation from a user; and a display control step of controlling a display unit so as to display an image of a VR space in which the at least two VR contents selected in the selection step are arranged side by side, wherein in a first case in which a first VR content and a second VR content are selected in the selection step, in the display control step, the display unit is controlled so as to display an image of the VR space in which a first region for displaying the first VR content and a second region for displaying the second VR content are arranged side by side. 18.A computer program product including a program causing a computer to execute each step of the control method according to claim 17. 19.A computer-readable storage medium storing a program causing a computer to execute each step of the control method according to claim 17.