Information processing device and information processing program

The information processing device and program address the issue of reduced visibility in augmented reality by controlling image movement to prevent contact with objects, ensuring clear visibility through strategic image placement and movement.

JP7753753B2Active Publication Date: 2025-10-15FUJIFILM BUSINESS INNOVATION CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2021157061
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-09-27
Publication Date
2025-10-15
Estimated Expiration
2041-09-27

AI Technical Summary

Technical Problem

In augmented reality spaces, objects in the real world can overlap with and impair the visibility of augmented reality images when they come into contact, leading to reduced visibility of the augmented reality image.

Method used

An information processing device and program that control the placement and movement of augmented reality images to prevent contact with moving objects, ensuring visibility by moving the images away from potential contact points.

Benefits of technology

Ensures the visibility of augmented reality images by controlling the movement of images to avoid contact with objects, utilizing depth direction, user operations, and object movements to maintain necessary visibility.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007753753000001
    Figure 0007753753000001
  • Figure 0007753753000002
    Figure 0007753753000002
  • Figure 0007753753000003
    Figure 0007753753000003
Patent Text Reader

Abstract

To secure sufficient visibility of an augmented reality image when an object tries to touch the augmented reality image.SOLUTION: An information processing device 10 comprises a CPU 11. The CPU 11 provides control to place an augmented reality image in an augmented reality space and to move the augmented reality image so as to avoid contact when a movable object moves to come into contact with the augmented reality image.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an information processing device and an information processing program. [Background technology]

[0002] Patent Document 1 discloses an information processing device that enables a user experiencing augmented reality to perceive the possibility of contact with an object in the real world. This information processing device displays the virtual object semi-transparently or as an outline when the display area of ​​the real object is hidden by the virtual object and the distance between the observer and the real object is within a predetermined distance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-4493 Summary of the Invention [Problem to be solved by the invention]

[0004] In an augmented reality space, when an object such as a person in the real world moves into the display frame of an image drawn in the augmented reality, such as an icon for performing an operation, the object and the augmented reality image may come into contact and overlap. In this way, some object may come into contact with the augmented reality image, impairing the visibility of the augmented reality image.

[0005] An object of the present disclosure is to provide an information processing device and an information processing program that ensure the visibility of an augmented reality image when an object is about to come into contact with the augmented reality image. [Means for solving the problem]

[0006] An information processing device according to a first aspect of the present disclosure includes a processor, which controls the placement of an augmented reality image in an augmented reality space, and when a moving object moves so as to come into contact with the augmented reality image, controls the movement of the augmented reality image so as not to come into contact with the object.

[0007] An information processing device according to a second aspect of the present disclosure is an information processing device according to the first aspect of the present disclosure, wherein the processor, in controlling the movement, moves the object in a direction toward the rear so as not to come into contact with the object and to reduce the augmented reality image.

[0008] An information processing device according to a third aspect of the present disclosure is an information processing device according to the first or second aspect of the present disclosure, wherein the processor performs the movement control when the augmented reality image is the object of operation of a user operating the augmented reality space or the object of the user's line of sight.

[0009] An information processing device according to a fourth aspect of the present disclosure is an information processing device according to the first or second aspect of the present disclosure, wherein the processor performs the movement control when, when multiple augmented reality images are placed in the augmented reality space, another augmented reality image adjacent to the augmented reality image that has become the target of contact due to the movement of the object is the target of operation of a user operating the augmented reality space or the target of the user's line of sight.

[0010] An information processing device according to a fifth aspect of the present disclosure is an information processing device according to any of the first to fourth aspects of the present disclosure, wherein the processor, in the movement control, moves the augmented reality image to a space that is not within the movement range of the object.

[0011] An information processing device according to a sixth aspect of the present disclosure is an information processing device according to any of the first to fifth aspects of the present disclosure, wherein the processor performs the movement control when the augmented reality image is the subject of movement control, and does not perform the movement control when the augmented reality image is not the subject of movement control.

[0012] An information processing device according to a seventh aspect of the present disclosure is an information processing device according to any of the first to sixth aspects of the present disclosure, and, after the movement control, performs control to return the moved augmented reality image to its original position before the movement when the object moves away from the original position before the movement of the augmented reality image.

[0013] An information processing device according to an eighth aspect of the present disclosure is an information processing device according to any one of the first to seventh aspects of the present disclosure, wherein, in the movement control, the processor controls the movement of the augmented reality image to a space that does not come into contact with another object placed in the augmented reality space and does not contain the other object placed therein.

[0014] An information processing device according to a ninth aspect of the present disclosure is an information processing device according to any of the first to eighth aspects of the present disclosure, wherein when a plurality of augmented reality images are arranged in the augmented reality space, the processor controls the movement of the plurality of augmented reality images so that the object does not come into contact with the object when the object moves so as to come into contact with any of the plurality of augmented reality images.

[0015] An information processing device according to a tenth aspect of the present disclosure is an information processing device according to the ninth aspect of the present disclosure, wherein, in the movement control, the processor moves an individual augmented reality image among the plurality of augmented reality images that is subject to contact with the object to a space that does not come into contact with the object and that does not contain other augmented reality images.

[0016] An information processing device according to an eleventh aspect of the present disclosure is an information processing device according to any of the first to tenth aspects of the present disclosure, wherein the processor moves the augmented reality image that has become the target of contact due to the movement of the object to a space outside the display area.

[0017] An information processing device according to a twelfth aspect of the present disclosure is an information processing device according to the ninth aspect of the present disclosure, wherein the processor controls the movement so that the augmented reality image that has become the subject of contact due to the movement of the object is superimposed on a portion of another augmented reality image.

[0018] An information processing device according to a thirteenth aspect of the present disclosure is an information processing device according to the ninth or twelfth aspect of the present disclosure, wherein the processor controls the movement of the augmented reality image that has become the subject of contact due to the movement of the object so that it is adjacent to another augmented reality image of a related type, depending on the type of the augmented reality image.

[0019] An information processing program according to a fourteenth aspect of the present disclosure causes a computer to execute a process that controls the placement of an augmented reality image in an augmented reality space, and when a moving object moves so as to come into contact with the augmented reality image, controls the movement of the augmented reality image so as not to come into contact with the object. [Effects of the Invention]

[0020] According to the first and fourteenth aspects of the present disclosure, the visibility of the augmented reality image is ensured when an object is about to come into contact with the augmented reality image.

[0021] According to the second aspect of the present disclosure, the depth direction can be utilized to ensure visibility of an augmented reality image.

[0022] According to the third aspect of the present disclosure, necessary visibility can be ensured in response to a user's operation.

[0023] According to the fourth aspect of the present disclosure, necessary visibility can be ensured in response to a user's operation.

[0024] According to the fifth aspect of the present disclosure, visibility can be ensured according to the range of movement of the object.

[0025] According to the sixth aspect of the present disclosure, necessary visibility can be ensured depending on the image.

[0026] According to the seventh aspect of the present disclosure, the arrangement can be rearranged in accordance with the movement of the object.

[0027] According to the eighth aspect of the present disclosure, it is possible to avoid other objects and ensure necessary visibility.

[0028] According to the ninth aspect of the present disclosure, visibility can be ensured for a plurality of augmented reality images.

[0029] According to the tenth aspect of the present disclosure, visibility can be ensured by moving the image to a position that does not affect other augmented reality images.

[0030] According to the eleventh aspect of the present disclosure, visibility can be ensured by utilizing the outside of the display area.

[0031] According to the twelfth aspect of the present disclosure, space can be secured and visibility can be ensured.

[0032] According to the thirteenth aspect of the present disclosure, visibility can be ensured according to the relevance of an augmented reality image. [Brief explanation of the drawings]

[0033] [Figure 1] FIG. 10 is a diagram illustrating an example of a menu icon rendered in augmented reality. [Figure 2] 1 is a diagram illustrating a configuration of an information processing system according to an embodiment of the present disclosure. [Figure 3] 10 is a flowchart showing the flow of basic drawing control processing of an augmented reality image for a device of an information processing device. [Figure 4] 10 is a flowchart showing the flow of icon movement processing of the information processing device. [Figure 5] FIG. 10 is a diagram illustrating an example of a case where the entire icon is moved. [Figure 6] FIG. 10 is a diagram showing an example of a case where an icon is moved to an empty space. [Figure 7] FIG. 10 is a diagram illustrating an example of a case where an icon is moved so as to be reduced in size. [Figure 8] FIG. 10 is a diagram illustrating an example of a case where an icon that is an object of a user's operation is moved. [Figure 9] FIG. 10 is a diagram showing an example of a case where an image is moved to a space outside the display area. [Figure 10] 10A and 10B are diagrams showing variations in which the image is moved upward to a space outside the display area. [Figure 11] 10A and 10B are diagrams showing variations in which the image is moved to a space outside the display area. [Figure 12] FIG. 10 is a diagram showing an example of a case where a plurality of objects are moving so as to come into contact with an icon. [Figure 13] FIG. 10 is a diagram illustrating an example of a case where another object such as an obstacle exists in the augmented reality space. [Figure 14] FIG. 10 is a diagram showing an example of a case where icons are moved adjacent to each other depending on their types. [Figure 15] This is an example of placing one icon in an augmented reality space. [Figure 16] This is an example of placing an icon in an augmented reality space and moving the icon as if shrinking it. DETAILED DESCRIPTION OF THE INVENTION

[0034] An example of an embodiment of the present disclosure will be described below with reference to the drawings. The same reference numerals are used throughout the drawings to designate identical or equivalent components and parts. The dimensional proportions of the drawings are exaggerated for illustrative purposes and may differ from the actual proportions.

[0035] First, an outline of the present embodiment will be described. The information processing system of the present embodiment performs processing on an augmented reality space that is displayed superimposed on real space. The augmented reality space is rendered in the field of view of a user wearing an HMD (Head-Mounted Display) or the like. Hereinafter, the HMD may refer to a smart device capable of visual rendering, such as eyeglass-type AR (Augmented Reality) glasses. The AR glasses render an image (hereinafter simply referred to as an augmented reality image) that is superimposed and displayed in the user's field of view as augmented reality. The user can operate the augmented reality by moving their hands, feet, or the like. Various sensors associated with the AR glasses detect the user's line of sight, the user's movement within the field of view, and the movement of external objects. The augmented reality image is rendered as, for example, a menu icon and content, and follows the direction of the user's face, i.e., the field of view. The user can operate the augmented reality image by moving their line of sight or by moving their fingertips in the augmented reality. FIG. 1 is a diagram showing an example of a menu icon rendered in augmented reality. In the example of FIG. 1, images of a menu icon MI and an operation icon OI are drawn in an augmented reality space V. The augmented reality space V includes both the inside and outside of the display area displayed on the AR glasses. The operation icon OI can be operated by eye gaze or fingertip movements. By operating the operation icon OI and selecting a menu icon, the user can experience an image of content corresponding to the type of icon displayed in augmented reality. Examples of icon types include icons for content such as the Internet, video viewing, and SNS, and auxiliary icons such as help and settings. Each menu icon is an example of an augmented reality image of the present disclosure. Hereinafter, the term "icon" refers to an icon drawn as an augmented reality image.

[0036] In this embodiment, it is assumed that in such an augmented reality space, moving objects such as people and pets exist in addition to the user operating the augmented reality. If the moving object comes into contact with the augmented reality image and overlaps with it, the visibility of the augmented reality image is impaired. If the user changes their field of view, the augmented reality image will follow the object-free space, but forcing the user to change their field of view each time may not be desirable as a user interface. Therefore, in the method according to this embodiment, when an object is about to come into contact with the augmented reality image, the augmented reality image is moved to ensure visibility. Note that the following example describes the case of moving the image of a menu icon, but this is not limited to this. The method can be applied to images of other content other than menu icons as long as they are rendered as an augmented reality image.

[0037] The configuration of an information processing system 1 according to an embodiment of the present disclosure will be described with reference to Fig. 2. As shown in Fig. 1, in the information processing system 1, an information processing device 10 and a device 30, which is an AR glass, are connected via a network N.

[0038] The hardware configuration of the information processing device 10 will be described. In this embodiment, a device such as a computer or a server may be applied as the information processing device 10. The information processing device 10 according to this embodiment includes a CPU 11, a memory 12 as a temporary storage area, a non-volatile storage unit 13, and a communication unit 14 that communicates with external devices. Each component is connected to one another via a bus B2.

[0039] The storage unit 13 is realized by a storage device such as an HDD, SSD, or flash memory. The storage unit 13, which serves as a storage medium, stores an information processing program 13A. The CPU 11 reads the information processing program 13A from the storage unit 13, loads it into the memory 12, and sequentially executes processes included in the information processing program 13A. The information processing program 13A executes a drawing control process that controls the creation and drawing of an augmented reality image on the display unit 35 of the device 30, and a movement process that moves the augmented reality image. Commands for the drawing control process and the movement process are sent to the device 30. The display unit 35 of the device 30 controls the display based on the commands. The information processing program 13A also executes object detection required for the movement process from an image received from the device 30. The storage unit 13 also stores various pieces of information that need to be stored, such as an information storage unit 13B. The information storage unit 13B stores various pieces of information required for the augmented reality processing of the device 30, as well as information on the allowable distance, which will be described later. The information processing program 13A may be provided and processed on the device 30 side. In this case, the device 30 functions as the information processing device of the present disclosure.

[0040] The device 30 includes various devices for drawing and manipulating augmented reality images. The device 30 includes a CPU 31, a memory 32, a storage unit 33, a communication unit 34, a display unit 35, an imaging unit 36, an audio unit 37, and an analysis unit 38. These components are connected to each other via a bus C2. The storage unit 33 stores information about augmented reality images, such as icons and content to be drawn in the drawing control process. The display unit 35 is the glasses portion, receives drawing control process commands from the information processing device 10, reads necessary data from the storage unit 33, and displays the augmented reality images. The imaging unit 36 ​​is a photographing device, such as a camera, that captures images of real space and transmits the captured images to the information processing device 10. The imaging unit 36 ​​is located at the center, left edge, or right edge, or at a position suitable for mounting on a glasses-type device. The imaging unit 36 ​​also includes an internal sensor that detects the user's line of sight. The audio unit 37 converts data into audio and outputs it through earphones or speakers. The analysis unit 38 performs necessary analysis on the captured image. The object detection performed by the information processing program 13A of the information processing device 10 may be performed by the analysis unit 38. Note that the configuration of the device 30 is not limited to this.

[0041] A description will be given of the flow of information processing by the information processing device 10. Fig. 3 is a flowchart showing the flow of basic rendering control processing of an augmented reality image for the device 30 of the information processing device 10.

[0042] In step S100, the CPU 11 receives a request from the device 30 to start the augmented reality.

[0043] In step S102, the CPU 11 arranges an image of the menu in the augmented reality space in response to the start-up request. The image arranged in the augmented reality space is then displayed by the display unit 35 of the device 30.

[0044] In step S104, the CPU 11 accepts an operation in the augmented reality space by the user. The user performs an operation by operating the operation icon OI with his / her line of sight or the movement of his / her fingertip.

[0045] In step S106, the CPU 11 renders an image of the augmented reality content in response to the operation.

[0046] Next, a description will be given of a process for moving an icon when a moving object is moving so as to come into contact with an icon of the menu in a state where an augmented reality menu image is drawn. Fig. 4 is a flowchart showing the flow of the process for moving an icon of the menu in the information processing device 10.

[0047] In step S200, the CPU 11 detects an object moving in the augmented reality space. The detection of the moving object is performed by receiving an image captured by the imaging unit 36 ​​of the device 30, analyzing the image, and detecting movement information such as the object's position, movement information, and movement speed. Note that the object may also be detected by the analysis unit 38 on the device 30 side.

[0048] In step S202, the CPU 11 determines whether the moving object is moving so as to come into contact with the menu icon. If it is determined that the object is moving so as to come into contact, the process proceeds to step S204; if it is determined that the object is not moving so as to come into contact, the process returns to step S200 and repeats the detection process. Whether the object is moving so as to come into contact can be determined by determining in advance the allowable distance standard, such as the distance at which the icons are allowed to approach or the depth of contact, and using the allowable distance standard. If the distance between the moving object and the icon satisfies the allowable distance standard, the object is determined to be moving so as to come into contact; if the distance does not satisfy the allowable distance standard, the object is determined not to be moving so as to come into contact. The allowable distance standard may also be changed depending on the moving speed and size of the moving object, etc. The allowable distance standard may also be determined depending on the type of icon.

[0049] In step S204, the CPU 11 performs control to move the image of the icon of the augmented reality menu in the augmented reality space so as not to come into contact with any moving object.

[0050] Regarding the control of moving the icon image in step S204 above, there are various variations on how to move it, and the variations will be explained below.

[0051] FIG. 5 is a diagram illustrating an example of a case in which the entire icon is moved. In the example of FIG. 5, icons MIa, MIb, and MIc are respectively arranged in an augmented reality space. (A1) to (A3) show a time series transition when a person in the space moves as a moving object U1 from the left side so as to come into contact with icon MIa. In this case, icons MIa, MIb, and MIc are moved to the right so as to close the space between them and avoid contact with object U1. In this control of icon movement, the icon can be moved so as to adjust the entire icon. Furthermore, the case of adjusting the entire icon is not limited to the example of closing the space between icons. If there is space in the vertical direction, the icons may be moved vertically. For example, as shown in (B3), if there is space in the downward direction, icons MIa, MIb, and MIc can be moved downward so as not to come into contact with object U1. The movement direction of the icon may also be determined by predicting the movement direction of object U1. In this case, the acceleration of object U1 is detected, and if it is predicted that the object U1 will move further to the right, the icon is moved in a direction other than the movement direction of object U1, as shown in (B3) rather than (A3).

[0052] Fig. 6 is a diagram showing an example of a case where an icon is moved to an empty space. In the example of Fig. 6, there is an empty space in the space of icon MIb in the example of Fig. 5. Therefore, when object U1 moves so as to come into contact with icon MIa, icon MIa is moved to the empty space on the right. With this movement control, icons can be moved individually to empty spaces.

[0053] FIG. 7 is a diagram showing an example of a case in which an icon is moved so as to be reduced. In the example shown in (C1), the icon MIa is moved in the depth direction as the direction of movement so as to be reduced. In the example shown in (C2), the icon MIa is moved in the depth direction so as to be reduced, and is moved so as to be superimposed on a part of the icon MIb. In the example shown in (C3), the icon MIa itself is reduced without being moved in the depth direction, and is moved so as to be superimposed on a part of the icon MIb. Note that in this embodiment, the icon MIa is moved so as to be superimposed on the bottom of an icon MIb different from the icon MIa, but the superimposed area is not limited to the bottom, as long as it is moved so as to be superimposed on a part of the icon MIb. For example, the icon MIa may be moved so as to be superimposed on the top of the icon MIb.

[0054] FIG. 8 is a diagram showing an example of a case where an icon being operated by a user is moved. (D1) to (D3) show a time series transition when, when icon MIa is the operation target of operation icon OI, a moving object U1 moves from the left side so as to come into contact with icon MIa. In this case, icon MIa is the operation target of operation icon OI, so control to move is performed. On the other hand, as shown in (D2'), when icon MIa is the operation target of operation icon OI, it is not moving so as to come into contact. Therefore, control to move is not performed in this case. Furthermore, this may be applied when the operation icon OI is the target of the user's line of sight instead of the user's line of sight.

[0055] FIG. 9 is a diagram showing an example of a case where icon MIa is moved to a space outside the display area. (E1) to (E3) show a time series transition when, when icon MIa is the operation target of operation icon OI, a moving object U1 moves from the left side to contact icon MIa. In this case, in (E3), icon MIa is moved to the space on the left side outside display area J. At this time, notification information nn indicating the destination of icon MIa is displayed. For example, if the name of the icon is "XX," notification information nn can be an arrow indicating the direction of movement and the words "XX Menu." Notification information nn is not limited to display, but may also be a notification by audio or a notification sound. Furthermore, as shown in (E4), icon MIa can be displayed again within display area J by moving the user's gaze. Furthermore, icon MIa may be returned to display area J by a user's motion, not limited to a gaze movement. At this time, if icon MIc moves outside display area J, notification information nn for icon MIc is displayed. Similar processing is possible for the following cases of moving outside display area J.

[0056] FIG. 10 shows variations of moving an icon to a space outside the display area J in the upward direction. For example, if the direction of movement outside the display area J is not preset, the icon is displayed in the upward direction outside the display area J, as shown in (E2*) and (E3*). For such upward movement, it is generally considered that there is a low possibility of obstacles, such as other objects, being present in the upward direction. Therefore, the icon is moved to a space that is not within the range of movement of such a moving object. Note that the positions of obstacles inside and outside the display area J may be detected in advance, and control may be exercised to move the icon outside the display area J in a direction where there are no or few obstacles. FIG. 11 shows variations of moving an icon to a space outside the display area. For example, as shown in (E2') and (E3'), if icon MIa is the object of operation or the object of the user's line of sight, icon MIc, which is not the object of operation, may be moved outside the display area J, and icons MIa and MIb may be moved to the right. Furthermore, as shown in (E4'), if another icon MIb adjacent to the contacted icon MIa is the object of operation or the object of the user's line of sight, the position of icon MIb is not moved, and icon MIa is moved outside the display area J. The same applies when a moving object U2 is present and the icon MIc becomes a contact target. It is also possible to determine whether each icon is subject to movement control. For example, when an icon becomes a contact target, if the icon is subject to movement control, the icon is moved, but if the icon is not subject to movement control, the icon is not moved.

[0057] 12 is a diagram showing an example of a case where multiple objects are moving so as to come into contact with icons. As shown in (F1), when object U1 is moving so as to come into contact with icon MIa and object U2 is moving so as to come into contact with icon MIc, control is performed to move the icons as in (F2-1) or (F2-2). In (F2-1), icons MIa and MIc are moved upward out of display area J. In (F2-2), icons MIa and MIc are moved backward so as to shrink.

[0058] 13 is a diagram showing an example of a case where another object, such as an obstacle, exists in the augmented reality space. The examples shown in (G1) and (G2) are cases where another object E, such as a television, exists between the icon MIa and the icon MIc. When the object U1 moves so as to come into contact with the icon MIa as shown in (G1), the icon MIa is moved outside the display area J to avoid the object E as shown in (G2). Note that the direction may be upward or downward as long as it does not collide with the object E, and the direction of movement may be determined taking into account the user's line of sight or the target of operation, the angle of the device 30, etc.

[0059] Fig. 14 is a diagram showing an example of a case where icons are moved adjacent to each other depending on their types. In the example of Fig. 14, it is assumed that the types of icons MIa and MIc are content menus, and the type of icon MIb is a help menu. When an object U1 moves so as to come into contact with icon MIa as shown in (H1), icon MIa is moved adjacent to icon MIc of the same type as shown in (H2).

[0060] Although the above description has been given taking an example in which a plurality of icons are arranged, the method of this embodiment can also be applied to the case in which a single icon is arranged.

[0061] FIG. 15 shows an example in which one icon is placed in an augmented reality space. In the example of FIG. 14, only the icon MIa is placed in the augmented reality space. When the object U1 moves so as to come into contact with the icon MIa as shown in (I1), the icon MIa is moved to the right so as not to come into contact with the object U1 as shown in (I2). Furthermore, when the object U1 moves further to the right and moves away from its original position before the movement as shown in (I3), the icon MIa is controlled to return to its original position. Note that the control of returning to its original position before the movement as shown in (I3) may also be applied to the case of multiple icons described above. FIG. 16 shows an example in which one icon is placed in an augmented reality space and moved so as to shrink. When the object U1 moves so as to come into contact with the icon MIa as shown in (J1), the icon MIa is moved backward so as to shrink so as not to come into contact with the object U1 as shown in (J2). Furthermore, as shown in (J3), when the object U1 moves further to the right and moves away from its original position before the movement, the icon MIa is controlled to return to its original size and to its original position.

[0062] As described above, according to this embodiment, when an object is about to come into contact with an augmented reality image, the visibility of the augmented reality image can be ensured.

[0063] The present disclosure is not limited to the above-described embodiments, and various modifications and applications are possible within the scope of the gist of the disclosure.

[0064] In the above embodiments, the information processing performed by the CPU after reading the software (program) may be performed by various processors other than the CPU. Examples of such processors include programmable logic devices (PLDs) (such as field-programmable gate arrays (FPGAs)) whose circuit configuration can be changed after fabrication, and dedicated electrical circuits such as application-specific integrated circuits (ASICs) that are processors with circuit configurations specifically designed to perform specific processing. The information processing may be performed by one of these various processors, or by a combination of two or more processors of the same or different types (e.g., multiple FPGAs, or a combination of a CPU and an FPGA). The hardware structure of these various processors is, more specifically, an electrical circuit that combines circuit elements such as semiconductor devices.

[0065] In the above embodiment, the information processing program is pre-stored (installed) in a ROM or storage device, but the present invention is not limited to this. The program may be provided in a form recorded on a non-transitory recording medium such as a CD-ROM (Compact Disk Read Only Memory), a DVD-ROM (Digital Versatile Disk Read Only Memory), or a USB (Universal Serial Bus) memory. The program may also be downloaded from an external device via a network.

[0066] Furthermore, the operations of the processors in the above embodiments may not only be performed by a single processor, but may also be performed by multiple processors located at physically separate locations working together. Furthermore, the order of the operations of the processors is not limited to the order described in the above embodiments, and may be changed as appropriate. [Explanation of symbols]

[0067] 1. Information Processing Systems 10. Information processing equipment 11, 31 CPUs 12, 32 memory 13, 33 Storage section 13A Information Processing Program 13B Information storage section 14, 34 Communications Department 30 devices 35 Display section 36 Imaging unit 37 Voice conversion unit 38 Analysis Department

Claims

1. having a memory and a processor, The processor: Control the placement of augmented reality images in the augmented reality space, When a moving object moves so as to come into contact with the augmented reality image, control is performed to move the augmented reality image so as not to come into contact with the object; In the control of the movement, the object is moved in a direction away from the object so as not to come into contact with the object and to reduce the augmented reality image. Information processing device.

2. The processor: The information processing device according to claim 1 , wherein the movement control is performed when the augmented reality image is an object of operation by a user who operates the augmented reality space or an object of the user's line of sight.

3. The processor: When a plurality of augmented reality images are placed in the augmented reality space, When another augmented reality image adjacent to the augmented reality image that has become the contact target due to the movement of the object is the operation target of a user who operates the augmented reality space or the target of the user's line of sight, The information processing device according to claim 1 , wherein the movement control is performed on the augmented reality image that has been contacted.

4. The processor: The information processing device according to any one of claims 1 to 3, wherein the control of movement involves moving the augmented reality image to a space that is not within a movement range of the object.

5. The processor: If the augmented reality image is a target of movement control, the movement control is performed; The information processing device according to any one of claims 1 to 4, wherein when the augmented reality image is not a target of movement control, the movement control is not performed.

6. The processor: After the moving control, An information processing device according to any one of claims 1 to 5, wherein when the object moves away from its original position before the augmented reality image is moved, the information processing device controls the augmented reality image to return to its original position before the movement.

7. The processor: An information processing device according to any one of claims 1 to 6, wherein in the movement control, if there is another object placed in the augmented reality space, control is performed to move the augmented reality image to a space that does not come into contact with the object and where there is no other object placed.

8. The processor: When a plurality of augmented reality images are placed in the augmented reality space, An information processing device as described in any one of claims 1 to 7, wherein when the object moves so as to come into contact with any of the plurality of augmented reality images, the movement of the plurality of augmented reality images is controlled so as not to come into contact with the object.

9. The processor: The information processing device described in claim 8, wherein in the movement control, an individual augmented reality image among the plurality of augmented reality images that is the subject of contact with the object is moved to a space that does not contact the object and that does not contain other augmented reality images.

10. The processor: The information processing device according to any one of claims 1 to 9, wherein the augmented reality image that has become a contact target due to the movement of the object is moved to a space outside a display area.

11. The processor: The information processing device according to claim 8 , wherein the movement control is performed so that the augmented reality image that has become a contact target due to the movement of the object is superimposed on a part of another augmented reality image.

12. The processor: Regarding the augmented reality image that has become a contact target due to the movement of the object, The information processing device according to claim 8 or 11, wherein the control of moving the augmented reality image is performed in accordance with the type of the augmented reality image so that the augmented reality image is adjacent to another augmented reality image of a related type.

13. On the computer, Control the placement of augmented reality images in the augmented reality space, When a moving object moves so as to come into contact with the augmented reality image, control is performed to move the augmented reality image so as not to come into contact with the object; In the control of the movement, the object is moved in a direction away from the object so as not to come into contact with the object and to reduce the augmented reality image. An information processing program that executes processing.

Citation Information

Patent Citations

  • Image processor and control method thereof

    JP2016004493A

  • Head mounted type display device, head mounted type display device control method, computer program

    JP2018084886A

  • Information processing equipment, information processing system, control method thereof and program

    JP2019028772A

  • Information processing device, control method thereof, and program

    JP2020024752A

  • Information processing device, information processing system, control method therefor, and program

    JP2020187778A