Method

Abstract

To improve a technology that provides a simulation for a compartment of a vehicle.SOLUTION: A method that is executed by a terminal device 20 includes: receiving, via an input unit 24, user inputs for a vehicle that the user is considering to purchase, and an environment condition on the vehicle; transmitting, via a communicating unit 23, first information representing the vehicle and the environment condition; transmitting, via the communicating unit 23, second information representing an object that is placed by the user in the compartment of the vehicle; obtaining, via the communicating unit 23, an image which is generated based on the first information and on the second information, and which represents the object placed in the vehicle under the environment condition; and outputting, via an outputting unit 25, the image.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a method.

Background Art

[0002] Conventionally, there has been a technology that provides a simulation of a vehicle cabin to a user who is considering purchasing a vehicle. For example, Patent Document 1 discloses a vehicle interior simulation device that can obtain a final interior image by sequentially combining selectable images of the vehicle interior and displaying a three-dimensional image of the entire interior step by step for confirmation.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] A user may want to know the situation where personal belongings are placed in the vehicle scheduled to be purchased, but it is difficult to check with an actual vehicle. Thus, there has been room for improvement in the technology that provides a simulation of a vehicle cabin to a user who is considering purchasing a vehicle.

Means for Solving the Problems

[0005] The method according to the present disclosure is a method executed by a terminal device including an input unit, an output unit, a communication unit, and a control unit. The control unit receives an input from the user regarding a vehicle the user is considering purchasing and environmental conditions in which the vehicle is placed via the input unit, transmits first information indicating the vehicle and the environmental conditions via the communication unit, transmits second information indicating an object the user will place in the passenger compartment of the vehicle via the communication unit, acquires, via the communication unit, an image representing the object placed in the vehicle under the environmental conditions, which is generated based on the first information and the second information, and outputs the image via the output unit.

Effect of the Invention

[0006] According to the present disclosure, it is possible to improve the technology for providing a simulation of the passenger compartment of a vehicle.

Brief Description of the Drawings

[0007]

Figure 1

Figure 2

Figure 3

Figure 4A

Figure 4B

Mode for Carrying Out the Invention

[0008] <First Embodiment> Hereinafter, a first embodiment of the present disclosure will be described with reference to the drawings. In each drawing, the same or corresponding parts are denoted by the same reference numerals. In the description of the present embodiment, the description of the same or corresponding parts will be omitted or simplified as appropriate.

[0009] Referring to FIG. 1, the configuration of the system 1 according to the present embodiment will be described. The system 1 includes an information processing apparatus 10 and a terminal device 20. The information processing apparatus 10 can communicate with the terminal device 20 via a network 30.

[0010] The information processing apparatus 10 is a computer installed in a facility such as a data center. The information processing apparatus 10 is, for example, a server belonging to a cloud computing system or other computing system. The information processing apparatus 10 is operated by a business operator selling vehicles.

[0011] The terminal device 20 is held by a user. The terminal device 20 is, for example, a mobile device such as a mobile phone, a smartphone, or a tablet, or a PC. "PC" is an abbreviation for personal computer.

[0012] The network 30 includes the Internet, at least one WAN, at least one MAN, or any combination thereof. "WAN" is an abbreviation for wide area network. "MAN" is an abbreviation for metropolitan area network. The network 30 may include at least one wireless network, at least one optical network, or any combination thereof. The wireless network is, for example, an ad hoc network, a cellular network, a wireless LAN, a satellite communication network, or a terrestrial microwave network. "LAN" is an abbreviation for local area network.

[0013] First, an overview of the present embodiment will be described, and details will be described later. The terminal device 20 receives an input from the user regarding a vehicle the user is considering purchasing and environmental conditions in which the vehicle is placed, transmits first information indicating the vehicle and the environmental conditions, and transmits second information indicating an object to be placed in the vehicle cabin of the vehicle. The terminal device 20 acquires an image representing an object placed in the vehicle under the environmental conditions, which is generated based on the first information and the second information, and outputs the image.

[0014] The environmental conditions indicate the environment in which the vehicle cabin is placed, such as the weather, time of day, and degree of brightness by the lighting fixtures in the vehicle cabin, and can be input by the user as described below. According to the present embodiment, it is possible to easily confirm the vehicle cabin of the vehicle that the user is considering purchasing, together with the objects placed in the cabin, under the specified environmental conditions. This makes it easier for the user to imagine the cabin when they themselves get in the vehicle. Therefore, it is possible to improve the technology for providing a simulation of the vehicle cabin.

[0015] Referring to FIG. 1, the configuration of the information processing apparatus 10 according to the present embodiment will be described. The information processing apparatus 10 includes a control unit 11, a storage unit 12, and a communication unit 13.

[0016] The control unit 11 includes at least one processor, at least one programmable circuit, at least one dedicated circuit, or any combination thereof. The processor is a general-purpose processor such as a CPU or GPU, or a dedicated processor specialized for specific processing. "CPU" is an abbreviation for central processing unit. "GPU" is an abbreviation for graphics processing unit. The programmable circuit is, for example, an FPGA. "FPGA" is an abbreviation for field-programmable gate array. The dedicated circuit is, for example, an ASIC. "ASIC" is an abbreviation for application specific integrated circuit. The control unit 11 executes processes related to the operation of the information processing apparatus 10 while controlling each part of the information processing apparatus 10.

[0017] The storage unit 12 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or any combination thereof. The semiconductor memory is, for example, RAM, ROM, or flash memory. "RAM" is an abbreviation for random access memory. "ROM" is an abbreviation for read only memory. RAM is, for example, SRAM or DRAM. "SRAM" is an abbreviation for static random access memory. "DRAM" is an abbreviation for dynamic random access memory. ROM is, for example, EEPROM. "EEPROM" is an abbreviation for electrically erasable programmable read only memory. The flash memory is, for example, SSD. "SSD" is an abbreviation for solid-state drive. The magnetic memory is, for example, HDD. "HDD" is an abbreviation for hard disk drive. The storage unit 12 functions as, for example, a main memory device, an auxiliary storage device, or a cache memory. The storage unit 12 stores information used for the operation of the information processing apparatus 10 and information obtained by the operation of the information processing apparatus 10.

[0018] The communication unit 13 includes at least one communication module. The communication module is a module compatible with a wired LAN communication standard such as Ethernet (registered trademark) or a wireless LAN communication standard such as IEEE802.11. "IEEE" is an abbreviation for Institute of Electrical and Electronics Engineers. The communication unit 13 communicates with devices other than the information processing apparatus 10. The communication unit 13 receives information used for the operation of the information processing apparatus 10 and transmits information obtained by the operation of the information processing apparatus 10.

[0019] Referring to FIG. 1, the configuration of the terminal device 20 according to this embodiment will be described. The terminal device 20 includes a control unit 21, a storage unit 22, a communication unit 23, an input unit 24, an output unit 25, and a photographing unit 26. The hardware configurations of the control unit 21, the storage unit 22, and the communication unit 23 of the terminal device 20 may be the same as those of the control unit 11, the storage unit 12, and the communication unit 13 of the information processing device 10, respectively. The description here is omitted.

[0020] The input unit 24 includes at least one input interface. The input interface is, for example, a physical key, a capacitance key, a pointing device, a touch screen provided integrally with a display, or a microphone. The input unit 24 receives an operation for inputting data used for the operation of the terminal device 20. Instead of being provided in the terminal device 20, the input unit 24 may be connected to the terminal device 20 as an external input device. As a connection method, for example, any method such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used. "USB" is an abbreviation for Universal Serial Bus. "HDMI (registered trademark)" is an abbreviation for High-Definition Multimedia Interface.

[0021] The output unit 25 includes at least one output interface. The output interface is, for example, a display or a speaker. The display is, for example, an LCD or an organic EL display. "LCD" is an abbreviation for liquid crystal display. "EL" is an abbreviation for electro luminescence. The output unit 25 outputs data obtained by the operation of the terminal device 20. Instead of being provided in the terminal device 20, the output unit 25 may be connected to the terminal device 20 as an external output device. As a connection method, for example, any method such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used.

[0022] The imaging unit 26 is a camera that images the surroundings of the terminal device 20. The imaging unit 26 may be a camera capable of three-dimensionally imaging a subject, such as a TOF (Time Of Flight) camera or a stereo camera. The imaging unit 26 can output the acquired image to the control unit 21. For example, the imaging unit 26 is provided on the surface opposite to the output unit 25.

[0023] The functions of the information processing device 10 or the terminal device 20 are realized by executing the program according to the present embodiment with a processor as the control unit 11 or the control unit 21. That is, the functions of the information processing device 10 or the terminal device 20 are realized by software. The program causes a computer to execute the operations of the information processing device 10 or the terminal device 20, thereby causing the computer to function as the information processing device 10 or the terminal device 20. That is, the computer functions as the information processing device 10 or the terminal device 20 by executing the operations of the information processing device 10 or the terminal device 20 according to the program.

[0024] The program can be stored in a non-transitory computer-readable medium. The non-transitory computer-readable medium is, for example, a flash memory, a magnetic recording device, an optical disk, a magneto-optical recording medium, or a ROM. The distribution of the program is performed, for example, by selling, transferring, or lending a portable medium such as an SD card, a DVD, or a CD-ROM storing the program. "SD" is an abbreviation for Secure Digital. "DVD" is an abbreviation for digital versatile disc. "CD-ROM" is an abbreviation for compact disc read only memory. The program may be stored in the storage of a server and transferred from the server to other computers to distribute the program. The program may be provided as a program product.

[0025] The computer stores, for example, a program stored in a portable medium or a program transferred from a server in the main memory device once. Then, the computer reads the program stored in the main memory device with the processor and executes the processing according to the read program with the processor. The computer may directly read the program from the portable medium and execute the processing according to the program. The computer may sequentially execute the processing according to the received program each time a program is transferred from the server to the computer. The processing may be executed by a so-called ASP-type service that realizes the function only by execution instructions and result acquisition without transferring the program from the server to the computer. "ASP" is an abbreviation for application service provider. The program includes information for use in processing by an electronic computer and things conforming to the program. For example, data that is not a direct instruction to the computer but has the property of defining the processing of the computer corresponds to "things conforming to the program".

[0026] Some or all of the functions of the information processing apparatus 10 or the terminal apparatus 20 may be realized by a programmable circuit or a dedicated circuit as the control unit 11 or the control unit 21. That is, some or all of the functions of the information processing apparatus 10 or the terminal apparatus 20 may be realized by hardware.

[0027] With reference to FIGS. 2 and 3, the operation of the system 1 according to the present embodiment will be described. Among the operations shown in FIG. 2, the operation of the terminal apparatus 20 corresponds to the method according to the present embodiment. Hereinafter, it is assumed that the communication between the information processing apparatus 10 and the external apparatus is performed via the communication unit 13 and the network 30, and the communication between the terminal apparatus 20 and the external apparatus is performed via the communication unit 23 and the network 30.

[0028] In S101 of FIG. 2, the control unit 11 of the information processing apparatus 10 transmits setting information indicating at least one sales vehicle and environmental options where the vehicle is placed to the terminal device 20. The setting information may be stored in advance in the storage unit 12 of the information processing apparatus 10. The environmental options include weather, time zone, and the degree of brightness by the lighting fixtures in the vehicle cabin. In this example, the environmental options for weather include "rain", "sunny", "cloudy", etc. The environmental options for time zone include "morning", "noon", "evening", "night", etc. The environmental options for the degree of brightness by the lighting fixtures in the vehicle cabin include "high", "medium", "low", etc. Not limited to this, the environmental options may include temperature, humidity, etc. The setting information may include interior options for a plurality of cabins for the same vehicle. The interior options may include, for example, materials, colors, etc. of seats, dashboards, etc.

[0029] In S102, the control unit 21 of the terminal device 20 acquires it by receiving the setting information.

[0030] In S103, the control unit 21 outputs at least one vehicle indicated by the setting information and the environmental options via the output unit 25. Any method may be adopted for the output. For example, the control unit 21 may output by displaying at least one vehicle and the environmental options on the output unit 25 using icons or the like. In this example, the control unit 21 outputs vehicle CA, vehicle CB, and vehicle CC, and as environmental options, three types of weather of "rain", "sunny", "cloudy", three types of time zones of a day of "morning", "noon", "night", and three types of degrees of brightness by the lighting fixtures in the vehicle cabin of "low", "medium", "high" via the output unit 15. When the setting information includes interior options for the vehicle cabin, the control unit 21 outputs the interior options.

[0031] In S104, the control unit 21 of the terminal device 20 receives, via the input unit 24, an input of the vehicle that the user is considering purchasing and the environmental conditions in which the vehicle is placed. Any method may be adopted for receiving the input. For example, the control unit 11 may receive, as an input, an operation in which the user selects the icon output in S103 via the input unit 24. In this example, it is assumed that the control unit 21 receives an input of vehicle CA as the vehicle that the user is considering purchasing. In this example, it is assumed that the control unit 11 receives an input of the weather of "sunny", the time zone of "night", and the brightness level by the lighting fixtures in the vehicle cabin of the vehicle at a level of "medium" as the environmental conditions. When the setting information includes the interior options of the vehicle cabin, the control unit 21 may further receive an input from the user for the interior options.

[0032] In S105, the control unit 21 generates first information indicating the vehicle and the environmental conditions received in S104, and transmits the first information to the information processing device 10. The first information may include the interior options of the vehicle cabin input by the user.

[0033] In S106, the control unit 11 of the information processing device 10 acquires it by receiving the first information.

[0034] In S107, the control unit 21 of the terminal device 20 generates and transmits second information indicating the object to be placed in the vehicle cabin by the user. Any method may be used for generating the second information. For example, the control unit 21 may acquire, from the imaging unit 26, a two-dimensional captured image in which the object is captured using the imaging unit 26 by the user, and generate the second information including the captured image. In this case, the control unit 21 may acquire a plurality of two-dimensional captured images in which the object is captured from a plurality of directions and generate the second information. Not limited thereto, the control unit 21 may acquire a three-dimensional captured image from the imaging unit 26 and generate the second information including the three-dimensional captured image. In this example, it is assumed that the control unit 11 generates the second information including the three-dimensional captured images of the bag B and the tissue paper box K as the objects.

[0035] In S108, the control unit 11 of the information processing apparatus 10 acquires it by receiving the second information.

[0036] In S109, the control unit 11 acquires first three-dimensional data representing the vehicle cabin under the environmental conditions indicated by the first information. The three-dimensional data includes, for example, a three-dimensional model, point cloud data, mesh data, etc. Any method may be adopted for acquiring the first three-dimensional data. For example, the control unit 11 refers to the information indicating the vehicle cabin for each vehicle stored in advance in the storage unit 12 and acquires the three-dimensional data of the vehicle indicated by the first information. The control unit 11 may also acquire it by applying the environmental conditions indicated by the first information to the three-dimensional data using any image processing technology and generating the first three-dimensional data with the lighting conditions adjusted, etc. When the first information includes the interior options of the vehicle cabin, the control unit 21 acquires the first three-dimensional data representing the vehicle cabin provided with the interior options under the environmental conditions.

[0037] In S110, the control unit 11 acquires second three-dimensional data representing the object indicated by the second information. Any method may be adopted for acquiring the second three-dimensional data. For example, the control unit 11 may acquire it by generating second three-dimensional data representing the object in a three-dimensional shape by any image processing technology based on a plurality of two-dimensional captured images representing the object captured from a plurality of directions. The control unit 11 may also acquire it by extracting three-dimensional data from the three-dimensional captured image indicated by the second information. Without being limited thereto, the control unit 11 may also acquire it by reading out the three-dimensional data of the object from the database of the three-dimensional data stored in advance in the storage unit 12. In this example, it is assumed that the control unit 11 acquires it by extracting three-dimensional data from the three-dimensional captured images of the bag B and the tissue paper box K indicated by the second information.

[0038] In S111, the control unit 11 generates an image obtained by synthesizing the first three-dimensional data and the second three-dimensional data. In this example, the synthesized image is a three-dimensional image representing the vehicle cabin under the environmental conditions indicated by the first information where the object indicated by the second information is placed. However, it is not limited to this, and the control unit 11 may generate a two-dimensional image as the synthesized image. Any method may be adopted for generating the synthesized image. For example, the control unit 11 may generate an image representing an object placed at a preset position such as on the seat in the vehicle cabin. The position may also be preset by the user. The control unit 11 may use any image processing technology to apply the environmental conditions indicated by the first information to the object and generate an image representing the object with the way of light hitting it and the like adjusted.

[0039] In S112, the control unit 11 transmits the generated image to the terminal device 20.

[0040] In S113, the control unit 21 of the terminal device 20 receives the image from the information processing device 10.

[0041] In S114, the control unit 21 outputs the received image via the output unit 25. FIG. 3 is a diagram showing an example of the image output to the output unit 25 of the terminal device 20. In FIG. 3, the cabin R of the vehicle CA is displayed under the environmental conditions where the weather indicated by the first information is "sunny", the time zone is "night", and the degree of cabin lighting is "medium". In the cabin R, a bag B and a box K of tissue paper as the objects indicated by the second information are placed. By viewing the three-dimensional image output to the output unit 25, the user can vividly imagine the vehicle cabin. Then, the operation of the system 1 ends.

[0042] <Second Embodiment> Next, a second embodiment of the present disclosure will be described. Since the configuration of the system 1 according to the second embodiment is the same as that of the first embodiment described above, the description thereof will be omitted. Since the configurations of the information processing device 10 and the terminal device 20 according to the second embodiment are the same as those of the above-described embodiments, the description thereof will be omitted.

[0043] Hereinafter, the operation of the system 1 according to the present embodiment will be described with reference to FIGS. 4A and 4B.

[0044] From S201 to S206 in FIG. 4A are the same as S101 to S106 in FIG. 2 according to the first embodiment described above, and thus the description thereof will be omitted.

[0045] In S207, the control unit 21 receives an input of the usage of the user's vehicle via the input unit 24. The usage may include, for example, "commuting", "going to school", "fishing", "golfing", "daily use", etc. For example, the control unit 21 may display a plurality of icons indicating the usage on the output unit 25 and receive an operation in which the user designates at least one of the icons via the input unit 24. In this example, it is assumed that the control unit 21 has received an input designating "golf" as the usage of the user's vehicle.

[0046] In S208, the control unit 21 generates information indicating the usage and transmits it to the information processing apparatus 10.

[0047] In S209, the control unit 11 of the information processing apparatus 10 receives the information indicating the usage.

[0048] In S210, the control unit 11 generates information indicating at least one article corresponding to the usage purpose indicated by the information received in S209, and transmits it to the terminal device 20. The at least one article corresponding to the usage purpose refers to an article that is likely to be placed in the vehicle compartment by the user, such as being brought in, when the vehicle is used for the said usage purpose. The at least one article corresponding to the usage purpose may be stored in advance in the storage unit 12 of the information processing device 10 in association with the usage purpose. For example, when the usage purpose is "daily use", the articles corresponding to the usage purpose may include "a box of tissue paper", "a seat mat", and "a shopping bag", etc. When the usage purpose is "commuting", the articles corresponding to the usage purpose may include "a business bag", "a PC case", etc. When the usage purpose is "fishing", the articles corresponding to the usage purpose may include "fishing tackle", "a cooler box", etc. When the usage purpose is "golf", the articles corresponding to the usage purpose may include "a golf bag", "a round bag", etc. In this example, the control unit 11 generates information indicating "a golf bag" and "a round bag" as at least one article corresponding to the usage purpose, and transmits it to the terminal device 20.

[0049] In S211, the terminal device 20 outputs at least one article corresponding to the usage purpose indicated by the information received in S210 via the output unit 25. In this example, the control unit 11 outputs "a golf bag" and "a round bag" via the output 25. The article may be displayed by an icon or the like.

[0050] In S212, the control unit 21 receives, via the input unit 24, the input of one or more articles selected by the user. In this example, it is assumed that the control unit 21 receives the input of "a golf bag" selected by the user from among "a golf bag" and "a round bag".

[0051] In S213 of FIG. 4B, the control unit 21 generates second information indicating the article input in S212 as an object, and transmits it to the information processing apparatus 10. In this example, it is assumed that the control unit 21 generates second information indicating the article "golf bag" as an object, and transmits it to the information processing apparatus 10.

[0052] In S214, the control unit 11 of the information processing apparatus 10 acquires it by receiving the second information.

[0053] Since S215 is the same as S109 in FIG. 2 according to the above-described first embodiment, the description thereof is omitted.

[0054] In S216, the control unit 11 acquires second three-dimensional data representing the object indicated by the second information. Any method may be adopted for acquiring the second three-dimensional data. For example, the control unit 11 may acquire it by reading out the three-dimensional data of the object from a database of three-dimensional data stored in advance in the storage unit 12. In this example, it is assumed that the control unit 11 acquires the three-dimensional data of the golf bag indicated by the second information.

[0055] Since S217 to S220 are the same as S111 to S114 in FIG. 2 according to the above-described first embodiment, the description thereof is omitted.

[0056] The present disclosure is not limited to the above-described embodiments. For example, two or more blocks described in the block diagram may be integrated, or one block may be divided. Instead of executing two or more steps described in the flowchart in time series according to the description, each step may be executed in parallel or in a different order according to the processing ability of the apparatus that executes the steps, or as necessary. Other changes are possible without departing from the spirit of the present disclosure.

[0057] For example, in S114 of the first embodiment or S220 of the second embodiment described above, the control unit 21 of the terminal device 20 may output a plurality of images arranged side by side to the output unit 25 at the same time. The plurality of images may be images generated by the information processing device 10 in S111 of FIG. 2 or S217 of FIG. 4B with any one of the passenger compartment of the vehicle, environmental conditions, or an object or an article corresponding to the use purpose being different. This enables the user to comprehensively compare the images of the passenger compartment of the vehicle under different conditions.

Explanation of Signs

[0058] 1 System 10 Information Processing Device 11 Control Unit 12 Storage Unit 13 Communication Unit 20 Terminal Device 21 Control Unit 22 Storage Unit 23 Communication Unit 24 Input Unit 25 Output Unit 26 Imaging Unit 30 Network

Claims

1. A method executed by a terminal device including an input unit, an output unit, a communication unit, and a control unit, comprising: the control unit: receiving, via the input unit, an input by the user regarding a vehicle the user is considering purchasing and environmental conditions in which the vehicle is placed; transmitting, via the communication unit, first information indicating the vehicle and the environmental conditions; transmitting, via the communication unit, second information indicating an object to be placed in the vehicle cabin by the user; acquiring, via the communication unit, an image representing the object placed in the vehicle under the environmental conditions, the image being generated based on the first information and the second information; outputting the image via the output unit.

2. The method according to claim 1, wherein the image is a three-dimensional image synthesized from first three-dimensional data representing the vehicle cabin under the environmental conditions and second three-dimensional data representing the object.

3. The method according to claim 1 or 2, wherein the environmental conditions further include the degree of brightness by lighting fixtures in the vehicle cabin.

4. The method according to claim 1 or 2, wherein the control unit: receiving, via the input unit, an input by the user regarding the usage of the vehicle; outputting, via the output unit, at least one article corresponding to the usage; receiving, via the input unit, an input of one or more articles selected by the user; transmitting, via the communication unit, second information indicating the article selected by the user as the object.

5. The method according to claim 1 or 2, wherein the terminal device includes a photographing unit, and the control unit further includes acquiring a photographed image in which the object photographed by the user is captured by the photographing unit, wherein the second information includes the photographed image.

Images