Information processing system, user terminal, and information processing method

Abstract

To enable a video having a sense of presence that suits the occasion to be more efficiently provided to users in a virtual purchasing action or event, a store observation, and a site observation using communication.SOLUTION: The above problem is solved by an information processing system in which an information processing device and a first user terminal are communicably connected, wherein the information processing device includes means for transmitting, to the first user terminal, first delivery data for displaying on the first user terminal the image of an object displayed so as to be selectable by a first user or an internal image, and means for transmitting, to the first user terminal, second delivery data for displaying on the first user terminal a live video that corresponds to the first delivery data, on the basis of the first user's operation in a prescribed region of the image or the internal image, and the first user terminal has display control means for displaying the image of an object or the internal image on the basis of the received first delivery data, and displaying the live video on the basis of the second delivery data.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an information processing system. , profit The present invention relates to a user terminal and an information processing method. [Background technology]

[0002] In recent years, it has become possible to view the street view of facilities in the Internet space and purchase products sold at the facilities. For example, a product purchase support system that enables virtual exploration of a shopping street that provides pre-set images using a mobile camera or multiple fixed cameras installed in the shopping street or store has been known (for example, see Patent Document 1). Summary of the Invention [Problem to be solved by the invention]

[0003] However, conventional technology only provides pre-set images, and after receiving product purchase operations from consumers or other users, performs general e-commerce site processing, and does not provide the sense of realism that is sometimes required for virtual purchasing activities using communication.

[0004] An object of the present disclosure is to more efficiently provide users with realistic video as needed in virtual purchasing behavior, events, store observations, and on-site observations using communication. [Means for solving the problem]

[0005] One embodiment of the present invention is an information processing system in which an information processing device and a first user terminal operated by a first user are communicatively connected, the information processing device comprising: a first transmission means for transmitting a selection screen for selecting one of a plurality of facilities including a single facility and a complex facility to the first user terminal, and when the one facility selected via the selection screen is the single facility, transmitting an internal image of the single facility corresponding to the single facility; to the first user terminal, and transmits first distribution data for displaying the first distribution data on the first user terminal. and when the one facility selected via the selection screen is the complex facility, transmitting first distribution data to the first user terminal, the first distribution data being a floor guide of the complex facility corresponding to the complex facility and for displaying on the first user terminal one tenant among a plurality of tenants included in the complex facility in a selectable manner. a first transmitting means for transmitting the The information on the single facility displayed on the first user terminal Internal Image When a specific operation is performed on the internal image and second distribution data for displaying a live video corresponding to the first user terminal on the first user terminal. and transmitting second distribution data to the first user terminal, and when a selection of a tenant is received from the floor guide displayed on the first user terminal, transmitting second distribution data to the first user terminal for displaying a live video image corresponding to the selected tenant on the first user terminal. and a second transmitting means for transmitting the first user terminal, a display control means for displaying the selection screen transmitted by the information processing device, which displays the internal image transmitted as first distribution data from the information processing device when the facility selected via the selection screen is the single facility, displays the live video transmitted as second distribution data from the information processing device when a specific operation is received on the internal image, displays the floor guide transmitted as first distribution data from the information processing device when the facility selected via the selection screen is the complex facility, and displays a selection of a tenant on the floor guide corresponding to the one tenant transmitted as second distribution data from the information processing device when a specific operation is received on the internal image; A display control means for displaying the live video Step, It is an information processing system having the above configuration. Effect of the Invention

[0006] According to one embodiment of the present invention, in virtual purchasing behavior, store observation, and on-site observation using communication, realistic images can be provided to users more efficiently as needed. [Brief description of the drawings]

[0007] [Figure 1] 1 is a configuration diagram of an example of an information processing system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of a computer according to the present embodiment. [Diagram 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of a smartphone according to the embodiment of the present invention. [Figure 4] 1 is a functional configuration diagram of an example of an information processing system according to an embodiment of the present invention. [Diagram 5] FIG. 11 is a diagram illustrating an example of building information. [Figure 6] FIG. 11 is a diagram illustrating another example of building information. [Figure 7] FIG. 11 is a diagram illustrating an example of internal image information. [Figure 8] FIG. 11 is a diagram illustrating an example of a live video distribution setting. [Figure 9] FIG. 2 is a diagram illustrating an example of map information. [Figure 10] FIG. 11 is a diagram illustrating an example of a registration process for map information. [Figure 11] 11A and 11B are diagrams illustrating another example of the registration process for map information. [Figure 12] 11 is a flowchart showing an example of a registration process of the information processing system according to the present embodiment. [Figure 13]10 is a flowchart showing an example of a display process of the information processing system according to the present embodiment. [Figure 14] FIG. 13 is an image diagram of an example of an exterior image. [Figure 15] 13 is a flowchart showing an example of a display process for the building type "single unit" of the information processing system according to the present embodiment. [Figure 16] FIG. 13 is an image diagram of an example of an internal image. [Figure 17] 11 is a flowchart showing an example of a display process for the building type "complex" of the information processing system according to the present embodiment. [Figure 18] FIG. 13 is an image diagram of an example of a floor guide. [Figure 19] 13 is a flowchart of an example of a display process when an operation on a predetermined area of ​​an internal image is received from an operator. [Figure 20] FIG. 13 is an image diagram of another example of the appearance image. [Figure 21] FIG. 13 is an image diagram of an example of live video. [Figure 22] FIG. 2 is a diagram illustrating an example of map information. [Figure 23] FIG. 13 is an image diagram of an example of live video. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, each embodiment of the present invention will be described with reference to the attached drawings. In the present embodiment, an example will be described in which the first user is a purchaser of a product, and the second user is a seller (person in charge) of the product, but the present invention is not limited to this example. In the present embodiment, the purchaser does not necessarily have to purchase the product, and includes a purchaser or a person who plans to purchase the product. The seller may be a store clerk, staff member, or attendant who deals with the purchaser.

[0009] [First embodiment] <System configuration> Fig. 1 is a configuration diagram of an example of an information processing system according to this embodiment. The information processing system 1 shown in Fig. 1 has an information processing device 10, a first user terminal 12, a live video distributor system 14, and a payment system 16, and communicates via a network 18. The live video distributor system 14 has a second user terminal 20, a camera 22, and an EC (Electronic commerce) site device 24. The live video distributor system 14 may have a configuration including the second user terminal 20 and multiple cameras 22. The network 18 is the Internet, a LAN (Local Area Network), or the like.

[0010] The first user terminal 12 is an information processing terminal operated by a purchaser of a product, etc. The first user terminal 12 is a PC (Personal Computer), a mobile phone, a smartphone, a tablet terminal, a game console, a PDA (Personal Digital Assistant), or the like.

[0011] The second user terminal 20 is an information processing terminal operated by a seller who deals with a purchaser, etc. The second user terminal 20 is a PC, a mobile phone, a smartphone, a tablet terminal, a game console, a PDA, or the like.

[0012] The information processing device 10 provides the service according to this embodiment. The information processing device 10 is a PC, a workstation, etc. The information processing device 10 may be realized by a server device, an ASP (Application Service Provider), or cloud computing.

[0013] The camera 22 is installed inside the building or in a product sales area inside the occupancy property. The camera 22 captures a 360-degree image of the surroundings as a captured image, and can distribute live video of the product sales area inside the building or in the occupancy property. The camera 22 can be, for example, a digital camera that can obtain a 360° full celestial sphere panoramic image in one shot. The camera 22 is not limited to a camera that captures 360-degree images, and can be, for example, a camera that can be operated from the first user terminal 12 to pan the shooting direction left and right and tilt the shooting direction up and down.

[0014] The camera 22 may be a wearable camera worn by the seller, or a built-in camera of the second user terminal 20 operated by the seller. A wearable camera is a camera worn by the seller on the head or shoulder, etc., and captures an image in the direction the seller is looking (eye level image) in a hands-free manner. The camera 22 may be a built-in camera of various smart devices such as a smartphone or smart glasses. The camera 22 communicates directly or via the second user terminal 20. The camera 22 can capture images of the product sales floor inside the building or the property, and distribute live images to the first user terminal 12.

[0015] The first user terminal 12 and the second user terminal 20 provide the buyers, etc. and the sellers with a two-way voice communication function using a call function, packet communication using voice data, WebRTC (Web Real-Time Communication), etc. The first user terminal 12 and the second user terminal 20 may also provide the buyers, etc. and the sellers with a two-way text communication function using a chat function, etc.

[0016] The EC site device 24 performs processes related to a website where a seller sells products, such as a product payment function. The EC site device 24 may be realized by, for example, a server device, an ASP, or cloud computing. The payment system 16 provides a product payment function.

[0017] The first user terminal 12 displays an exterior image of a building selected by the purchaser, etc. from a building selection image such as a map image. Therefore, the purchaser, etc. can select a building for which an interior image is to be displayed while referring to the exterior image of the building. The first user terminal 12 also displays an interior image of the building selected by the purchaser, etc. Therefore, the purchaser, etc. can select a store or tenant (tenant property) for which a live video of the interior of the building is to be displayed while referring to the interior image of the building.

[0018] For example, as described above, the first user terminal 12 can display an image captured from a 360-degree image of a store or a tenant in a shooting direction selected by the operation of a purchaser, etc., using an image captured by a digital camera that obtains a 360-degree omnidirectional panoramic image. The purchaser, etc. can check, for example, a location for which live video is desired to be displayed from the captured image displayed on the first user terminal 12. The first user terminal 12 also displays live video of the interior of the building at the location selected by the purchaser, etc.

[0019] If a purchaser finds a product that interests them, the purchaser or the like calls up the second user terminal 20 operated by the seller from the first user terminal 12 and starts two-way communication with the seller. The purchaser or the like can purchase the product by communicating with the seller by voice or chat while viewing live video of the interior of the building.

[0020] In this way, even if the purchaser or the like is engaged in a virtual purchase action using communication, the purchaser or the like can communicate with the seller while referring to live video of the interior of the selected store or tenant. Therefore, the purchaser or the like can inform the seller of the purchase of the product as if he or she were shopping at the actual store or tenant, and can enjoy a sense of immersion in the series of purchase actions. Unlike a system that continuously streams video, it is possible to more efficiently provide the purchaser or the like with a realistic video as needed.

[0021] For example, when actually going to a store or a tenant to purchase a product, the purchaser moves around while looking at the exterior of the store or tenant, and if a store or tenant catches his / her eye, he / she enters the store or tenant, looks around inside, and finds a product he / she is interested in. If he / she finds a product he / she is interested in, he / she listens to an explanation of the product from the seller, and then purchases the product.

[0022] In this embodiment, a display is provided on the first user terminal 12, which is in line with the case of actually going to a store or tenant to purchase a product, allowing communication between the purchaser and the seller, and allowing the purchaser to enjoy the immersive feeling of the series of purchasing actions as if they were actually shopping in the actual store or tenant.

[0023] The configuration of the information processing system 1 shown in Fig. 1 is an example. For example, at least a part of the functions of the information processing device 10 may be provided in the first user terminal 12. At least a part of the functions of the first user terminal 12 and the second user terminal 20 may be provided in the information processing device 10. At least a part of the functions of the payment system 16 and the EC site device 24 may be provided in the information processing device 10.

[0024] <Hardware configuration> "computer" The information processing device 10, the payment system 16, and the EC site device 24 in Fig. 1 are realized, for example, by a computer 500 having a hardware configuration as shown in Fig. 2. Furthermore, in the case of a PC, the first user terminal 12 and the second user terminal 20 in Fig. 1 are realized, for example, by a computer 500 having a hardware configuration as shown in Fig. 2. Fig. 2 is a hardware configuration diagram of an example of a computer according to this embodiment.

[0025] The computer 500 includes a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, a RAM (Random Access Memory) 503, a HD 504, a HDD (Hard Disk Drive) controller 505, a display 506, an external device connection I / F (Interface) 508, a network I / F 509, a data bus 510, a keyboard 511, a pointing device 512, a DVD-RW (Digital Versatile Disk Rewritable) drive 514, and a media I / F 516.

[0026] Of these, the CPU 501 controls the overall operation of the computer 500 in accordance with a program. The ROM 502 stores programs used to drive the CPU 501, such as the IPL. The RAM 503 is used as a work area for the CPU 501. The HD 504 stores various data such as programs. The HDD controller 505 controls the reading and writing of various data from and to the HD 504 in accordance with the control of the CPU 501.

[0027] The display 506 displays various information such as a cursor, a menu, a window, characters, or an image. The external device connection I / F 508 is an interface for connecting various external devices. In this case, the external device is, for example, a USB (Universal Serial Bus) memory. The network I / F 509 is an interface for data communication using the network 18. The data bus 510 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 501.

[0028] The keyboard 511 is a type of input means having a plurality of keys for inputting characters, numbers, various instructions, etc. The pointing device 512 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, etc. The DVD-RW drive 514 controls reading and writing of various data from a DVD-RW 513 as an example of a removable recording medium. Note that the medium is not limited to a DVD-RW, and may be a DVD-R or the like. The media I / F 516 controls reading and writing (storing) of data from a recording medium 515 such as a flash memory.

[0029] It should be noted that the hardware configuration shown in FIG. 2 is merely an example, and it is not necessary for the configuration to include all of the components shown in FIG. 2, or the configuration may include components other than those shown in FIG.

[0030] 《Smartphone》 The first user terminal 12 and the second user terminal 20 in Fig. 1 are realized by, for example, a smartphone 700 having a hardware configuration shown in Fig. 3. Fig. 3 is a hardware configuration diagram of an example of a smartphone according to this embodiment. As shown in Fig. 3, the smartphone 700 includes a CPU 701, a ROM 702, a RAM 703, an EEPROM 704, a CMOS sensor 705, an image sensor I / F 706, an acceleration / direction sensor 707, a media I / F 709, and a GPS receiver 711.

[0031] The CPU 701 controls the overall operation of the smartphone 700. The ROM 702 stores the CPU 701 and programs used to drive the CPU 701, such as the IPL. The RAM 703 is used as a work area for the CPU 701. The EEPROM 704 reads and writes various data, such as programs for the smartphone 700, under the control of the CPU 701.

[0032] The CMOS sensor 705 is a type of built-in imaging means that captures an image of a subject (mainly a self-portrait) under the control of the CPU 701 to obtain image data. Note that imaging means such as a CCD sensor may be used instead of the CMOS sensor 705. The imaging element I / F 706 is a circuit that controls the driving of the CMOS sensor 705. The acceleration / azimuth sensor 707 is one of various sensors such as an electronic magnetic compass or gyrocompass that detects geomagnetism, and an acceleration sensor.

[0033] A media I / F 709 controls reading and writing (storing) of data from and to a recording medium 708 such as a flash memory. A GPS receiving unit 711 receives GPS signals from GPS satellites.

[0034] The smartphone 700 also includes a long-distance communication circuit 712, a CMOS sensor 713, an image sensor I / F 714, a microphone 715, a speaker 716, an audio input / output I / F 717, a display 718, an external device connection I / F 719, a short-distance communication circuit 720, an antenna 720a of the short-distance communication circuit 720, and a touch panel 721.

[0035] The long-distance communication circuit 712 is a circuit that communicates with other devices via the network 18. The CMOS sensor 713 is a type of built-in imaging means that captures an image of a subject and obtains image data under the control of the CPU 701. The image sensor I / F 714 is a circuit that controls the drive of the CMOS sensor 713. The microphone 715 is a built-in circuit that converts sound into an electrical signal. The speaker 716 is a built-in circuit that converts an electrical signal into physical vibrations to produce sound such as music or voice.

[0036] The audio input / output I / F 717 is a circuit that processes input and output of audio signals between the microphone 715 and the speaker 716 under the control of the CPU 701. The display 718 is a type of display unit such as a liquid crystal or organic EL (Electro Luminescence) that displays an image of a subject, various icons, etc. The external device connection I / F 719 is an interface that connects various external devices. The short-range communication circuit 720 is a communication circuit such as NFC or Bluetooth. The touch panel 721 is a type of input unit that allows the user to operate the smartphone 700 by pressing the display 718.

[0037] The smartphone 700 also includes a bus line 710. The bus line 710 is an address bus, a data bus, or the like for electrically connecting the components such as the CPU 701 shown in FIG.

[0038] <Functional configuration> The information processing system 1 according to this embodiment is realized, for example, by a functional configuration as shown in Fig. 4. Fig. 4 is a functional configuration diagram of an example of the information processing system according to this embodiment. Note that the functional configuration diagram of Fig. 4 appropriately omits configuration unnecessary for the explanation of this embodiment. The information processing device 10, the first user terminal 12, the payment system 16, the second user terminal 20, the camera 22, and the EC site device 24 realize, for example, the functional configuration of Fig. 4 by executing programs such as an OS and applications.

[0039] The live video distributor system 14 in Fig. 4 is an example configuration having a second user terminal 20, a camera 22, and an EC site device 24. The live video distributor system 14 is provided for each store or tenant that displays live video from inside the building. The building in which the live video distributor system 14 is provided may be a single-story building or a multi-story building. Note that a building (building) is an example of an object, and is a concept that includes various facilities and places such as spaces (outdoor facilities) and virtual spaces.

[0040] The second user terminal 20 has a second communication execution unit 80 and a communication unit 82. The second communication execution unit 80 executes various processes required to provide the seller operating the second user terminal 20 with a two-way communication function with a purchaser or the like operating the first user terminal 12. The communication unit 82 communicates with the information processing device 10.

[0041] The camera 22 has an imaging unit 90 and a communication unit 92. The imaging unit 90 captures a 360-degree image of the surroundings. The communication unit 92 transmits live video of the store or tenant captured by the imaging unit 90 to the information processing device 10. Note that the communication unit 92 transmits the live video to the information processing device 10, for example, by transmitting the live video to a registered URL (a URL defined in the distribution settings).

[0042] The EC site device 24 has a payment processing unit 100, a communication unit 102, and a payment information storage unit 104. The payment processing unit 100 executes payment processing in response to a product purchase instruction from a purchaser or the like who operates the first user terminal 12. The communication unit 102 communicates with the information processing device 10. The payment information storage unit 104 stores payment information related to the executed payment processing.

[0043] The payment system 16 also has a payment processing unit 110, a communication unit 112, and a payment information storage unit 114. The payment processing unit 110 executes payment processing in response to a product purchase instruction from a purchaser or the like who operates the first user terminal 12. The communication unit 112 communicates with the information processing device 10. The payment information storage unit 114 stores payment information related to the executed payment processing. The payment system 16 is, for example, a system of an external payment service provider.

[0044] The first user terminal 12 has a display control unit 30, a first communication execution unit 32, a purchase reception unit 34, and a communication unit 36. The display control unit 30 displays an exterior image of a building, an interior image of the building, and a live video of the interior of the building based on various distribution data received from the information processing device 10. The exterior image of the building, the interior image of the building, and the live video of the interior of the building will be described in detail later.

[0045] The first communication execution unit 32 executes various processes required to provide a buyer or the like who operates the first user terminal 12 with a two-way communication function with a seller who operates the second user terminal 20. The purchase acceptance unit 34 accepts an instruction from a buyer or the like to purchase a product shown in the live video, for example. The communication unit 36 ​​communicates with the information processing device 10.

[0046] The information processing device 10 also has a map image generation unit 50, a communication unit 52, a communication function providing unit 54, a purchase processing unit 56, a memory control unit 58, a map information memory unit 70, a building information memory unit 72, an internal image information memory unit 74, and a live video distribution setting memory unit 76.

[0047] The map image generating unit 50 generates a map image in which one or more buildings are displayed in a selectable manner as a building selection image, using map information and building information described later. The communication unit 52 communicates with the first user terminal 12, the payment system 16, the second user terminal 20, the camera 22, and the EC site device 24. The communication unit 52 transmits distribution data of the building selection image, the exterior image of the building, the interior image of the building, and live video of the interior of the building to the first user terminal 12. The communication unit 52 encompasses the roles of the first transmission unit 37 and the second transmission unit 38. When the communication unit 52 transmits first distribution data to the first user terminal 12 for displaying the building selection image, the exterior image of the building, or the interior image of the building on the first user terminal 12, the communication unit 52 functions as the first transmission unit 37. When the communication unit 52 transmits second distribution data to the first user terminal 12 for displaying live video of the interior of the building corresponding to the first distribution data on the first user terminal 12, the communication unit 52 functions as the second transmission unit 38.

[0048] The communication function providing unit 54 provides purchasers using the first user terminal 12 and sellers using the second user terminal 20 with a voice communication function using a call function or a text communication function using a chat function.

[0049] The purchase processing unit 56 receives a purchase instruction for a product shown in the live video from the first user terminal 12 operated by a purchaser, etc., and executes the purchase process for the product. The memory control unit 58 controls the information stored in the map information memory unit 70, the building information memory unit 72, the interior image information memory unit 74, and the live video distribution setting memory unit 76.

[0050] The map information storage unit 70 stores map information. The map information is an example of information from which a building selection image can be generated. The map information can be acquired, for example, from a map information provider or a map information service. The map information does not necessarily have to be an actual map, and may be, for example, a virtual map of a virtual city or a virtual shopping mall (virtual mall).

[0051] The building information storage unit 72 stores building information, which will be described later. The interior image information storage unit 74 stores interior images of buildings, which will be described later. The live video distribution setting storage unit 76 stores live video distribution settings, which will be described later. The information processing device 10 may have a storage unit that stores a script. The script is a program for displaying 360-degree images in a first user terminal 12 that is not equipped with an application for displaying 360-degree images.

[0052] 4 is just an example, and some of the functions of the information processing device 10 may be provided in the first user terminal 12. The functional configuration of the information processing device 10 may be realized by a plurality of server devices.

[0053] A first user terminal 12 equipped with an application for displaying 360-degree images can display 360-degree images without using a script. The information processing device 10 may provide operations on 360-degree images as a Web service to a first user terminal 12 that does not have an application for displaying 360-degree images.

[0054] The building information storage unit 72 of the information processing device 10 shown in Fig. 4 stores, for example, building information shown in Fig. 5. Fig. 5 is a diagram for explaining an example of building information. The building information in Fig. 5 is information that associates a map, a position of a building on the map, building information, an exterior image of the building, and an interior image of the building.

[0055] FIG. 5(A) has items such as a balloon ID, a display position on a map, a registered name, and a building type. The balloon ID is an example of identification information of a balloon that is associated with a building on a map and displayed on the map. Note that a balloon is an example of a symbolic notation that accepts a selection by a purchaser or the like for a building on a map. The symbolic notation may be a pin, an icon, a mark, or the like other than a balloon, as long as it is an indication that accepts a selection by a purchaser or the like (in which case, a pin ID or the like may be used instead of a balloon ID). A balloon may be associated with an area on a map that includes multiple buildings, such as a shopping district.

[0056] The display position on the map indicates the position on the map image where the balloon is displayed. The display position on the map also indicates the position on the map image where building information such as the building name is displayed. The registered name indicates building information such as the building name to be displayed on the map. The building type indicates whether it is a "single" building, where an internal image of the building can be specified by selecting the building, or a "compound" building, where an internal image of the building can be specified by selecting the building and floor.

[0057] A "single" building, for which an internal image of the building can be specified by selecting the building, is, for example, a single-story building. A "complex" building, for which an internal image of the building can be specified by selecting the building and floor, is a multi-story building (complex facility) such as a building. Note that even if a building has multiple floors, it may be treated as a "single" building if the same tenant occupies multiple floors.

[0058] Fig. 5(B) has items such as a balloon ID and address information of an exterior image. The address information of the exterior image includes the URL of the transition destination of the exterior image of the building that is displayed when the balloon on the map is selected by clicking, the storage path, and the API of an external service.

[0059] Also, Fig. 5(C) has items of range information of the exterior image and address information of the interior image. The range information of the exterior image indicates the range on the exterior image that accepts selection by a click operation or the like from a purchaser, etc. The address information of the interior image is the transition destination URL of the interior image of the building that is displayed when the range on the exterior image shown in the range information of the external image (which can be specified by location information such as coordinates on a map or annotation information, for example) is selected by a click operation, the storage path, the API with the external service, etc.

[0060] Furthermore, the building information storage unit 72 of the information processing device 10 shown in Fig. 4 may store, for example, building information shown in Fig. 6. Fig. 6 is a diagram for explaining another example of building information. The building information in Fig. 6 is information that associates a map, the position of a multi-storey building on the map, information on the multi-storey building, information on a floor guide of the multi-storey building, exterior images of tenants etc. residing on each floor, and interior images of the tenants etc.

[0061] Fig. 6(A) is the same as Fig. 5(A). Fig. 6(B) has items such as a balloon ID, a floor, a registered name, and address information of an exterior image. The floor indicates a floor of a multi-floor building associated with the balloon ID. The registered name indicates information such as the tenants residing on each floor, and indicates information such as the tenant names to be displayed on the floor guide.

[0062] The address information of the exterior image includes the URL of the destination of the exterior image of a tenant, etc., which is displayed when a tenant name, etc., displayed on the floor guide is selected by clicking, etc., a storage path, an API with an external service, etc.

[0063] 6(C) has items of exterior image range information and internal image address information. The exterior image range information indicates the range on the exterior image that accepts selection by a purchaser or the like through a click operation. The internal image address information is the transition destination URL of the internal image of the tenant or the like that is displayed when the range on the exterior image shown in the external image range information is selected by a click operation or the like, the storage path, the API with the external service, etc.

[0064] The internal image information storage unit 74 of the information processing device 10 shown in Fig. 4 stores, for example, the internal image information shown in Fig. 7. Fig. 7 is a diagram for explaining an example of internal image information. The internal image information in Fig. 7 has items of internal image range information and live video address information. The internal image range information represents a range on the internal image that is selected by a purchaser or the like through a click operation or the like. The live video address information is, for example, a URL of a transition destination of a live video of the inside of a building that is displayed when a range on the internal image represented in the internal image range information is selected by a click operation or the like.

[0065] The live video distribution setting storage unit 76 of the information processing device 10 shown in Fig. 4 stores, for example, live video distribution settings as shown in Fig. 8. Fig. 8 is a diagram for explaining an example of a live video distribution setting. In the live video distribution setting in Fig. 8, the registered device ID of the camera 22 that distributes live video is associated with address information of the live video. The registered device ID is an example of identification information of the camera 22.

[0066] <Processing Overview> Fig. 9 is a diagram for explaining an example of map information. Fig. 9 is an example of a map image 1000 displaying map information, and shows, for example, a building 1002 such as a single-story building, and a multi-story building 1004 such as a building. By previously registering the building information in Fig. 5 and Fig. 6, the internal image information in Fig. 7, and the live video distribution setting in Fig. 8 in association with the map image 1000, the first user terminal 12 displays, for example, a map image 1000 as shown in Fig. 10.

[0067] Fig. 10 is a diagram for explaining an example of a registration process for map information. As shown in Fig. 10, a map image 1000 displays balloons 1006 at locations corresponding to buildings 1002 and 1004 for which the building information in Figs. 5 and 6, the internal image information in Fig. 7, and the live video distribution setting in Fig. 8 have been registered. By performing a click operation on the balloon 1006 on the map image 1000, the first user terminal 12 accepts the selection of the building 1002 or 1004 on the map image 1000 associated with the balloon 1006 for which the click operation has been accepted. Then, the first user terminal 12 displays the internal image and live video of the building 1002 or 1004 for which the selection has been accepted, as described below.

[0068] Fig. 11 is a diagram for explaining another example of the registration process for map information. The map image 1000 in Fig. 11 is an example in which a balloon 1006 is displayed at a location corresponding to an area 1010 on a map including a plurality of buildings such as a shopping street. By performing a click operation on the balloon 1006 at a location corresponding to the area 1010 on the map image 1000, the first user terminal 12 accepts the selection of the area 1010 associated with the balloon 1006 for which the click operation has been accepted. When the selection of the area 1010 is accepted, the first user terminal 12 displays an exterior image (for example, a full view of the shopping street) corresponding to the area 1010.

[0069] Fig. 20 is an image diagram of another example of an exterior image. Exterior image 1500 in Fig. 20 is an example of an exterior image of area 1010 corresponding to balloon 1006 in Fig. 11 selected by a purchaser or the like. Exterior image 1500 in Fig. 20 shows one or more buildings 1002 included in area 1010. Moreover, exterior image 1500 in Fig. 20 visually shows ranges 1501 and 1502 on the exterior image corresponding to range information of the exterior image, such as locations where one or more buildings 1002 included in area 1010 are shown. Note that ranges 1501 and 1502 on the exterior image do not need to be shown.

[0070] For example, a purchaser or the like operating the first user terminal 12 selects one building 1002 from the exterior image corresponding to the area 1010 by a click operation or the like, and causes the first user terminal 12 to display an interior image of the selected building 1002. Then, the first user terminal 12 displays the interior image and live video of the building 1002 that has been selected, as described below.

[0071] <Processing> A processing procedure of the information processing system 1 according to this embodiment will be described. Fig. 12 is a flow chart showing an example of the registration processing of the information processing system according to this embodiment. The registration processing shown in Fig. 12 is performed in advance.

[0072] In step S10, the storage control unit 58 of the information processing device 10 accepts settings for map information, for example, the map image 1000 in FIG. 9, to be stored in the map information storage unit 70 from an administrator or the like of a company that provides a service via the information processing device 10. In step S12, the storage control unit 58 accepts registration of a display position of the balloon 1006 from the administrator or the like. In step S14, the storage control unit 58 accepts registration of a building name, which is an example of building information for the building 1002 or 1004 corresponding to the balloon 1006, from the administrator or the like. In step S16, the storage control unit 58 accepts registration of a building type for the building 1002 or 1004 corresponding to the balloon 1006 from the administrator or the like. Through the processing of steps S10 to S16, the storage control unit 58 can register, for example, the building information in FIG. 5(A).

[0073] In step S18, the storage control unit 58 accepts, from an administrator or the like, registration of address information for an exterior image corresponding to the balloon 1006. By the process of step S18, the storage control unit 58 can register, for example, the building information of FIG.

[0074] In step S20, the storage control unit 58 accepts registration of address information of an internal image to which the external image is to be transitioned from, for example, an administrator. The storage control unit 58 can register the building information of FIG. 5(C) that associates range information of the external image with address information of the internal image by the processing of step S20.

[0075] In step S22, the storage control unit 58 accepts registration of address information of live video to which the internal image transitions from the internal image from an administrator or the like. The storage control unit 58 can register the internal image information of FIG. 7 that associates range information of the internal image with address information of the live video. The storage control unit 58 also accepts registration of the camera 22 that corresponds to the address information of the live video from an administrator or the like. The storage control unit 58 can register the live video distribution setting of FIG. 8 that associates address information of the live video with the registered device ID of the camera 22.

[0076] The storage control unit 58 repeats the processes of steps S12 to S24 until the registration process of the building 1002 or 1004 displayed on the map image 1000 is completed. Note that the administrator or the like only needs to perform the registration process for at least a part of the building 1002 or 1004 displayed on the map image 1000. Note that it is also possible to operate the exterior images, internal images, and live footage such that the address information of any of the exterior images, internal images, and live footage is photographed periodically, such as at a certain time or period, and updated and registered.

[0077] Fig. 13 is a flowchart showing an example of display processing of the information processing system according to this embodiment. In step S30, the communication unit 52 of the information processing device 10 transmits distribution data for displaying, for example, the map image 1000 of Fig. 10 on the first user terminal 12 to the first user terminal 12. The display control unit 30 of the first user terminal 12 displays, for example, the map image 1000 in which the balloon 1006 of Fig. 10 is registered, based on the distribution data received from the information processing device 10.

[0078] If the balloon 1006 is selected by the purchaser or the like, the display control unit 30 performs the processes in and after step S34. If the balloon 1006 is not selected by the purchaser or the like, the display control unit 30 skips the processes in steps S34 to S42.

[0079] In step S34, the display control unit 30 displays an exterior image corresponding to the selected balloon 1006. Fig. 14 is an image diagram of an example of an exterior image. Exterior image 1100 in Fig. 14 is an image diagram of a building 1002 on a map image 1000 corresponding to the balloon 1006 selected by a purchaser or the like. Exterior image 1100 in Fig. 14 visually shows a range 1102 on the exterior image corresponding to the range information of the exterior image in Fig. 5(C), for example. Note that the range 1102 on the exterior image does not need to be shown.

[0080] 11 is received from a purchaser or the like, the display control unit 30 displays a panoramic image corresponding to the area 1010. The purchaser or the like can check an exterior image of a building 1002 included in the area 1010 from the panoramic image corresponding to the area 1010 displayed on the first user terminal 12.

[0081] Here, an example will be described in which a selection operation on the balloon 1006 in Fig. 10 is accepted from a purchaser or the like. When an operation on the range 1102 on the external appearance image is accepted from the purchaser or the like in step S36, the display control unit 30 proceeds to processing from step S38 onwards. Note that if no operation on the range 1102 on the external appearance image is accepted in step S36 from the purchaser or the like, the processing of steps S38 to S42 is skipped.

[0082] In step S38, the display control unit 30 refers to the item "Building type" in Fig. 5(A), for example, to determine whether the building type of the building 1002 for which an operation from a purchaser or the like has been accepted is "single unit." If the building type is "single unit," the display control unit 30 executes processing for the building type "single unit" in step S40. If the building type is not "single unit," the display control unit 30 executes processing for the building type "combined" in step S42.

[0083] The process for the building type "single unit" in step S40 and the process for the building type "compound" in step S42 will be described later with reference to a flowchart. The processes in steps S32 to S44 are repeated until a termination operation is performed by the purchaser or the like.

[0084] Fig. 15 is a flowchart showing an example of display processing for the building type "single unit" of the information processing system according to this embodiment. In step S50, the display control unit 30 displays an internal image of the building 1002 corresponding to the range 1102 on the exterior image in which an operation from a purchaser or the like has been accepted. Fig. 16 is an image diagram of an example of the internal image.

[0085] The internal image in Fig. 16 is an image diagram of the internal image of building 1002 corresponding to range 1102 on the exterior image for which an operation from a purchaser or the like has been accepted. The internal image in Fig. 16 is an internal image corresponding to the address information of the internal image in Fig. 5(C). The internal image in Fig. 16 visually shows range 1200 on the internal image, which corresponds to the range information of the internal image in Fig. 7. Note that range 1200 on the internal image does not need to be shown.

[0086] The display control unit 30 repeats the process of steps S54 to S60 until an operation to end the display of the internal image is performed. When an operation to end the display of the internal image is performed, the display control unit 30 ends the process of the flowchart in FIG.

[0087] If an operation from the purchaser or the like on the range 1200 on the internal image is accepted in step S54, the display control unit 30 proceeds to the process of step S56 and subsequent steps. If an operation from the purchaser or the like on the range 1200 on the internal image is not accepted in step S54, the process returns to step S52.

[0088] 7 and the live video distribution settings in FIG. 8, and displays live video of the interior of the building 1002 corresponding to the predetermined area for which an operation from the purchaser, etc. has been accepted. The display control unit 30 continues to display the live video of the interior of the building 1002 in step S56 until an operation to end the display of the live video is accepted from the purchaser, etc. in step S58. When an operation to end the display of the live video is accepted from the purchaser, etc. in step S58, the display control unit 30 ends the display of the live video and returns to the processing of step S52.

[0089] 17 is a flowchart showing an example of a display process for the building type "complex" of the information processing system according to this embodiment. In step S70, the display control unit 30 displays a floor guide for the building 1004 corresponding to the range 1102 on the exterior image in which an operation from a purchaser or the like has been accepted.

[0090] Fig. 18 is an image diagram of an example of a floor guide. The floor guide 1300 in Fig. 18 is displayed based on the information shown in Fig. 6(B), for example. The floor guide 1300 in Fig. 18 is an example in which, when the building 1004 has multiple floors, the tenants residing on each floor are displayed in a selectable manner.

[0091] In step S72, the display control unit 30 accepts a selection operation of a tenant in the floor guide 1300 from the purchaser or the like. In step S74, the display control unit 30 identifies and displays an exterior image of the tenant for which a selection operation has been accepted from the purchaser or the like based on the information in FIG. 6(B). Note that the display control unit 30 may perform processing from step S104 onward of the display control unit 30, which will be described later, if the range indicating the tenant for which a selection operation has been accepted from the purchaser or the like is associated with address information of live video instead of address information of the exterior image of the tenant in the information in FIG. 6(B), for example. The display control unit 30 can also request the communication unit 52 of the information processing device 10 to start distributing live video without displaying the exterior image of the tenant, using the address information of the live video associated with the range on the map image 1000, etc., accepted from the purchaser or the like.

[0092] In step S76, when an operation from a purchaser or the like is received for the range on the exterior image indicated by the range information of the exterior image in FIG. 6(C), the display control unit 30 proceeds to processing from step S78 onwards. As described above in the explanation of the selection operation of a tenant in the floor guide 1300, the display control unit 30 may perform processing from step S104 onwards of the display control unit 30, which will be described later, if, for example, the address information of the live video is associated with the address information of the internal image in place of the address information of the internal image in the information in FIG. 6(C). The display control unit 30 can also request the communication unit 52 of the information processing device 10 to start distributing the live video without displaying the internal image, using the address information of the live video associated with the range on the exterior image received from the purchaser or the like. In addition, if no operation from a purchaser or the like is received for the range on the exterior image in step S76, the processing from steps S78 to S88 is skipped.

[0093] In step S78, the display control unit 30 displays an internal image of a tenant in the building 1004 corresponding to the area on the exterior image for which an operation from a purchaser or the like has been accepted. If an operation to end the display of the internal image has been accepted, the display control unit 30 skips the processes of steps S82 to S90. If an operation to end the display of the internal image has not been accepted, the display control unit 30 performs the processes of step S82 and onwards.

[0094] If no operation from the purchaser or the like on the range on the internal image is accepted in step S82, the process returns to step S80. If an operation from the purchaser or the like on the range on the internal image is accepted in step S82, the display control unit 30 proceeds to step S84 and subsequent steps.

[0095] In step S84, the display control unit 30 refers to the internal image information in Fig. 7 and the live video distribution settings in Fig. 8, and displays live video of the interior of the tenant in the building 1004 corresponding to the predetermined area for which an operation from the purchaser or the like has been accepted. The display control unit 30 continues to display the live video of the interior of the building 1004 in step S84 until an operation to end the display of the live video is accepted from the purchaser or the like in step S86. When an operation to end the display of the live video is accepted from the purchaser or the like in step S86, the display control unit 30 ends the display of the live video, and returns to the processing of step S80.

[0096] In step S90, if the display control unit 30 has not received an operation to end the display of the floor guide from the purchaser, etc., the process returns to step S72. If an operation to end the display of the floor guide has been received from the purchaser, etc., the display control unit 30 ends the process of the flowchart in FIG.

[0097] 19 is a flowchart of an example of a display process when an operation on a predetermined area of ​​an internal image is received from an operator. In step S100, the display control unit 30 receives an operation on an area 1200 on the internal image, which is an example of the predetermined area of ​​the internal image in FIG. 16, from a purchaser or the like.

[0098] In step S102, the display control unit 30 refers to the internal image information in FIG. 7 and determines whether or not the range 1200 on the internal image in which an operation has been accepted from a purchaser or the like is associated with address information of the live video.

[0099] If the range 1200 on the internal image where the operation was received from the purchaser or the like is associated with the address information of the live video, the display control unit 30 performs the process of step S104. In step S104, the display control unit 30 requests the communication unit 52 of the information processing device 10 to start distributing the live video, using the address information of the live video that was associated with the range 1200 on the internal image where the operation was received from the purchaser or the like. In step S106, the display control unit 30 starts distributing the live video, for example, as shown in FIG. 21. FIG. 21 is an image diagram of an example of the live video. The live video in FIG. 21 is the live video that was associated with the range 1200 on the internal image where the operation was received from the purchaser or the like, and is, for example, a live video that enlarges and displays a product.

[0100] If the range 1200 on the internal image for which an operation has been received from a purchaser or the like is not associated with address information of the live video, the display control unit 30 proceeds to step S108 and determines whether the range 1200 on the internal image for which an operation has been received from a purchaser or the like is associated with annotation information that adds an information tag (metadata) to specific data.

[0101] If the range 1200 on the internal image for which an operation has been received from a purchaser or the like is associated with annotation information, the display control unit 30 starts displaying the annotation information in step S110. If the range 1200 is not associated with annotation information, the display control unit 30 continues displaying the internal image in step S112.

[0102] In addition, the correspondence between the range 1200 on the internal image and the annotation information can be achieved, for example, by estimating a position on the internal image from the coordinate position using known technology or the shooting position of the camera 22, and registering the annotation information of the location displayed on the internal image in correspondence with the estimated position, thereby making it possible to display the annotation information of the range 1200 on the internal image that has been operated by a purchaser, etc.

[0103] In this embodiment, an example in which the camera 22 is installed inside the building has been described, but the camera 22 may be movable. For example, the camera 22 may be carried by the seller, may be worn by the seller, or may be attached to a self-propelled robot that patrols inside the building.

[0104] According to this embodiment, even if the purchasing behavior is virtual and takes place over communication, the purchaser can purchase a product while communicating with the seller as if he or she were shopping at an actual store or tenement, and can enjoy the immersive feeling of the entire purchasing process.

[0105] [Other embodiments] As another example of this embodiment, the information processing system 1 as described above can be applied to a virtual tour participation event using communication by a purchaser or the like. In this case, for example, a purchaser who has purchased a ticket for a desired tour in advance (or can purchase by transitioning to an EC site from within the virtual space) accesses a bus stop in the virtual space as shown in FIG. 22 and selects a corresponding tour bus (for example, tour bus B2 in FIG. 22) from the bus stop displayed on the map. By selecting the corresponding tour bus (a login operation may be required in addition to an operation of selecting a balloon or icon on the map containing location information), the purchaser can switch to a live video corresponding to the selected area (tour bus B2 on the map for which a ticket has been purchased), and for example, a live video of the view seen from the tour bus as shown in FIG. 23 is played, allowing the purchaser to enjoy a realistic tour. In addition, as another similar example, the information processing system 1 can be applied to virtual event participation in a concert, a play, or the like. In this case, the information processing system 1 can display live footage or combine images of the surroundings such as internal images based on seat selection by the purchaser, etc. from venue map information, etc., to provide a more realistic experience when necessary.

[0106] Furthermore, as another example of this embodiment, when the user is a person in charge of a store facility or other sites (such as a construction site or a warehouse), the information processing system 1 may be utilized for store observation / site inspection by the site manager, etc. In this case, for example, the site manager, etc. uses the first user terminal 12, and the person in charge or staff at the site uses the second user terminal 20 to execute each process described in this embodiment, thereby making it possible to carry out more realistic store observation and site inspection as necessary.

[0107] Each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, and a device such as an ASIC (Application Specific Integrated Circuit), a DSP (digital signal processor), an FPGA (field programmable gate array), or a conventional circuit module designed to execute each function described above.

[0108] The group of devices described in the examples merely shows one of a number of computing environments for implementing the embodiments disclosed herein. The present invention is not limited to the present embodiment, and the components in the present embodiment include those that can be easily conceived by a person skilled in the art, those that are substantially the same, and those that are within the scope of what is called equivalent. Furthermore, various omissions, substitutions, modifications, and combinations of the components can be made without departing from the spirit of the present embodiment. [Explanation of symbols]

[0109] 1. Information Processing Systems 10. Information processing device 12 First user terminal 14 Live video distribution system 16 Payment Systems 18 Network 20 Second User Terminal 22 Camera 24 EC site equipment 30 Display control unit 32 First Communication Executive Division 34 Purchase Reception Department 36 Communications Department 37 First transmitter 38 Second transmitter 50 Map image generation unit 52 Communications Department 54 Communication Functions Department 56 Purchase Processing Unit 58 Memory control unit 70 Map information storage unit 72 Building information storage unit 74 Internal image information storage unit 76 Live video distribution setting memory unit 80 Second Communication Executive Division 82 Communications Department 90 Photography Department 92 Communications Department [Prior art documents] [Patent documents]

[0110] [Patent Document 1] JP 2019-036258 A

Claims

1. An information processing system in which an information processing device and a first user terminal operated by a first user are communicatively connected, The information processing device includes: a first transmission means for transmitting to the first user terminal a selection screen allowing the user to select one of a plurality of facilities including a stand-alone facility and a complex facility, and when the one facility selected via the selection screen is the stand-alone facility, transmitting to the first user terminal first distribution data for causing the first user terminal to display an internal image of the stand-alone facility corresponding to the stand-alone facility, and when the one facility selected via the selection screen is the complex facility, transmitting to the first user terminal first distribution data for causing the first user terminal to selectably display a floor guide of the complex facility corresponding to the complex facility and a tenant of a plurality of tenants included in the complex facility; a second transmission means for, when a specific operation is received on the internal image of the single facility displayed on the first user terminal, transmitting second distribution data to the first user terminal for displaying live video corresponding to the internal image on the first user terminal, and for, when a selection of a tenant is received on the floor guide displayed on the first user terminal, transmitting second distribution data to the first user terminal for displaying live video corresponding to the one tenant on the first user terminal; having The first user terminal includes: a display control means for displaying the selection screen transmitted by the information processing device, which, when the facility selected via the selection screen is the single facility, displays the internal image transmitted as first distribution data from the information processing device, and when a specific operation is received on the internal image, displays the live video transmitted as second distribution data from the information processing device; and, when the facility selected via the selection screen is the complex facility, displays the floor guide transmitted as the first distribution data from the information processing device, and when a selection of one tenant is received on the floor guide, displays the live video corresponding to the one tenant transmitted as the second distribution data from the information processing device; have Information processing system.

2. The information processing system further comprises: a second user terminal operated by a second user is communicatively connected; The information processing device further comprises: a communication function providing means for providing a two-way communication function between a first user terminal operated by the first user and a second user terminal operated by the second user corresponding to the first user; 2. The information processing system according to claim 1, further comprising:

3. the selection screen includes a map image and an external appearance image of an object displayed to be selectable by the first user; The display control means displays a map image, the exterior image, the internal image, and the live video of the object in this order based on an operation of the first user.

3. The information processing system according to claim 1 or 2.

4. the selection screen includes a map image of objects displayed to be selectable by the first user; The display control means displays a map image of the object and the live video in that order based on an operation of the first user.

3. The information processing system according to claim 1 or 2.

5. the selection screen includes an appearance image of an object displayed to be selectable by the first user; The display control means displays the external appearance image of the object and the live video in that order based on an operation of the first user.

3. The information processing system according to claim 1 or 2.

6. When a predetermined condition is included in the first distribution data, the second transmission means transmits the second distribution data to the first user terminal that satisfies the predetermined condition.

6. An information processing system according to claim 1.

7. The second transmission means transmits to the first user terminal the second distribution data for displaying, as the live video, a live video captured by a camera capable of capturing a 360-degree image of the surroundings on the first user terminal.

7. An information processing system according to any one of claims 1 to 6.

8. a map image generating means for generating a map image of one or more of the objects in which an image of the object or objects is displayed in a selectable manner by symbolic notation; The information processing system according to any one of claims 3 to 5, further comprising:

9. When the display control means receives an operation from a first user on a predetermined area of ​​the internal image, if the predetermined area where the operation from the first user is received is associated with address information of the live video, the display control means displays the live video using the address information, and if the predetermined area where the operation from the first user is received is not associated with the address information of the live video, the display control means determines whether the predetermined area where the operation from the first user is received is associated with annotation information, and if the predetermined area where the operation from the first user is received is associated with the annotation information, displays the annotation information.

6. An information processing system according to claim 3.

10. A user terminal operated by a first user, a communication means for receiving from an information processing device a selection screen allowing a user to select one of a plurality of facilities including a single facility and a complex facility, and when the one facility selected via the selection screen is the single facility, receiving first distribution data for displaying an internal image of the single facility corresponding to the single facility, and when the one facility selected via the selection screen is the complex facility, receiving first distribution data for a floor guide of the complex facility corresponding to the complex facility and for selectably displaying one tenant of a plurality of tenants included in the complex facility, and when a specific operation is performed on the internal image of the displayed single facility, receiving second distribution data for displaying a live video corresponding to the internal image; a display control means for displaying the selection screen transmitted by the information processing device, the display control means displaying the internal image transmitted as first distribution data from the information processing device when the facility selected via the selection screen is the single facility, displaying the live video transmitted as second distribution data from the information processing device when a specific operation is received on the internal image, displaying the floor guide transmitted as the first distribution data from the information processing device when the facility selected via the selection screen is the complex facility, and displaying the live video corresponding to one tenant transmitted as the second distribution data from the information processing device when a selection of one tenant is received on the floor guide; A user terminal having the above configuration.

11. An information processing method executed by an information processing system in which an information processing device and a first user terminal operated by a first user are communicatively connected to each other, comprising: The information processing device includes: a first transmission step of transmitting to the first user terminal a selection screen allowing the user to select one of a plurality of facilities including a stand-alone facility and a complex facility, and if the one facility selected via the selection screen is the stand-alone facility, transmitting to the first user terminal first distribution data for displaying on the first user terminal an internal image of the stand-alone facility corresponding to the stand-alone facility, and if the one facility selected via the selection screen is the complex facility, transmitting to the first user terminal first distribution data for displaying on the first user terminal a floor guide of the complex facility corresponding to the complex facility, where one tenant of a plurality of tenants included in the complex facility can be selected; a second transmission step of, when a specific operation is received on the internal image of the single facility displayed on the first user terminal, transmitting second distribution data to the first user terminal for displaying live video corresponding to the internal image on the first user terminal, and, when a selection of a tenant is received on the floor guide displayed on the first user terminal, transmitting second distribution data to the first user terminal for displaying live video corresponding to the one tenant on the first user terminal; Run The first user terminal includes: a display control step of displaying the selection screen transmitted by the information processing device, the display control step being for displaying the internal image transmitted as first distribution data from the information processing device when the facility selected via the selection screen is the single facility, displaying the live video transmitted as second distribution data from the information processing device when a specific operation is received on the internal image, displaying the floor guide transmitted as the first distribution data from the information processing device when the facility selected via the selection screen is the complex facility, and displaying the live video corresponding to one tenant transmitted as the second distribution data from the information processing device when a selection of one tenant is received on the floor guide; Run Information processing methods.

12. The information processing system further comprises: a second user terminal operated by a second user is communicatively connected; The information processing device further comprises: a communication function providing step of providing a two-way communication function between a first user terminal operated by the first user and a second user terminal operated by the second user corresponding to the first user; The information processing method according to claim 11, further comprising the steps of:

13. the selection screen includes a map image and an external appearance image of an object displayed to be selectable by the first user; The display control step displays a map image, the exterior image, the internal image, and the live video of the object in this order based on an operation of the first user.

13. The information processing method according to claim 11 or 12.

14. the selection screen includes a map image of objects displayed to be selectable by the first user; The display control step displays the map image of the object and the live video in that order based on an operation of the first user.

13. The information processing method according to claim 11 or 12.

15. the selection screen includes an appearance image of an object displayed to be selectable by the first user; The display control step displays the external appearance image of the object and the live video in that order based on an operation of the first user.

13. The information processing method according to claim 11 or 12.

16. The second transmission step transmits the second distribution data to the first user terminal that satisfies a predetermined condition when the first distribution data satisfies the predetermined condition.

16. The information processing method according to any one of claims 11 to 15.

17. The second transmission step transmits, to the first user terminal, the second distribution data for displaying, as the live video, a live video captured by a camera capable of capturing a 360-degree image of the surroundings on the first user terminal.

17. An information processing method according to any one of claims 11 to 16.

18. a map image generating step of generating a map image of the object in which an image of one or more of the objects is displayed selectably by symbolic notation; 16. The method of claim 13, further comprising:

19. The display control step includes, when an operation from a first user is received on a predetermined area of ​​the internal image, if the predetermined area where the operation from the first user is received is associated with address information of the live video, displaying the live video using the address information, and, if the predetermined area where the operation from the first user is received is not associated with the address information of the live video, determining whether the predetermined area where the operation from the first user is received is associated with annotation information, and displaying the annotation information if the predetermined area where the operation from the first user is received is associated with the annotation information.

16. An information processing method according to any one of claims 13 to 15.

Images