Information processing system, information processing method, and program

Abstract

To provide an information processing system or the like capable of adjusting an impression of a space.SOLUTION: According to an aspect of the present invention, there is provided an information processing system including a processor, in which the processor is configured to execute the following steps by reading a program, in the reception step, an input of a desired impression value indicating an impression desired for an existing space or a newly generated new space is received, and in the selection step, an item recommended to be arranged in the existing space or the new space is selected on the basis of the desired impression value and an impression adjustment value of each item included in an item group prepared in advance.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] As disclosed in Patent Document 1, a device for generating an image with an adjusted impression is known. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2023-154753 Summary of the Invention [Problem to be solved by the invention]

[0004] The above-mentioned system can design an image based on an impression, but does not anticipate adjusting the impression for a space.

[0005] In view of the above circumstances, the present invention provides an information processing system and the like that can adjust the impression of a space. [Means for solving the problem]

[0006] According to one aspect of the present invention, there is provided an information processing system including a processor configured to execute the following steps by reading a program, wherein a reception step receives input of a desired impression value that represents the impression desired for an existing space or a new space to be newly generated, and a selection step selects items recommended for placement in the existing space or the new space based on the desired impression value and the impression adjustment value of each item included in a pre-prepared item group.

[0007] According to this aspect, the user can select items to configure a space with a desired impression, and as a result, the impression of the space can be adjusted by the selected items. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a configuration diagram illustrating an information processing system 1. FIG. [Figure 2] 2 is a block diagram showing the hardware configuration of the server device 10. FIG. [Figure 3] FIG. 2 is a block diagram showing the hardware configuration of the user terminal 20. [Figure 4] 1 is a block diagram showing functions realized by a server device 10 (controller 11) and a user terminal 20 (controller 21). [Figure 5] FIG. 2 is a diagram showing an example of a map showing the distribution of keywords displayed on the user terminal 20. [Figure 6] FIG. 10 is a diagram for explaining adjustment of impression values. [Figure 7] 10 is a diagram showing an example of an item arrangement image AI created by the impression prediction unit 117. FIG. [Figure 8] 1 is an activity diagram showing a first pattern of the flow of information processing (processing for adjusting the impression of an existing space) according to the first embodiment, which is executed by the information processing system 1. FIG. [Figure 9] 10 is an activity diagram showing a second pattern of the flow of information processing (processing for adjusting the impression of an existing space) according to the first embodiment, which is executed by the information processing system 1. FIG. [Figure 10] 10 is an activity diagram showing the flow of information processing (design processing of a new space) according to the second embodiment, which is executed by the information processing system 1. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below with reference to the accompanying drawings. Various features shown in the following embodiments can be combined with each other.

[0010] Incidentally, the program for realizing the software appearing in one embodiment may be provided as a non-transitory computer-readable medium, or may be provided so that it can be downloaded from an external server, or may be provided so that the program is started on an external computer and its functions are realized on a client terminal (so-called cloud computing).

[0011] Furthermore, various information processing according to an embodiment may realize input and output corresponding to the input. Here, the form of information referenced in such information processing (hereinafter referred to as reference information) is not limited as long as an output is obtained as a result of the input. The reference information may be, for example, rule-based information such as a database, a lookup table, or a predetermined function (including a decision formula such as a regression formula constructed using a statistical method), a trained model that has previously trained the correlation between input and output, or a large-scale language model that can output a desired result by inputting a prompt.

[0012] In one embodiment, a "unit" may include, for example, a combination of hardware resources implemented by a circuit in the broad sense and software information processing that can be specifically realized by these hardware resources. In one embodiment, various information is handled, and this information is represented, for example, by physical values ​​of signal values ​​representing voltage and current, high and low signal values ​​as a binary bit set consisting of 0 or 1, or quantum superposition (so-called quantum bits), and communication and calculations can be performed on a circuit in the broad sense.

[0013] Furthermore, a circuit in the broad sense is a circuit realized by at least an appropriate combination of a circuit, circuitry, processor, memory, etc. The processor may be a general-purpose processor or a dedicated circuit. That is, it includes an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)), etc.

[0014] 1. Hardware Configuration This section explains the hardware configuration.

[0015] <Information Processing System 1> 1 is a configuration diagram showing an information processing system 1. The information processing system 1 includes a communication line 2, a server device 10 (an example of an information processing device), and a plurality of user terminals 20. The server device 10 and the user terminals 20 are configured to be able to communicate with each other via the communication line 2. The connection between the server device 10 and the user terminals 20 may be wired or wireless.

[0016] In one embodiment of the information processing system 1, the information processing system 1 is made up of one or more devices or components. These components will be described below.

[0017] <Server device 10> Fig. 2 is a block diagram showing the hardware configuration of server device 10. As shown in Fig. 2, server device 10 includes a control unit 11, a storage unit 12, a communication unit 13, and a communication bus 14. Control unit 11, storage unit 12, and communication unit 13 are electrically connected within server device 10 via communication bus 14.

[0018] <Control unit 11> The control unit 11 processes and controls the overall operations related to the server device 10. The control unit 11 is, for example, a central processing unit (CPU). The control unit 11 realizes various functions related to the server device 10 by reading out predetermined programs stored in the storage unit 12. In other words, information processing by software stored in the storage unit 12 is specifically realized by the control unit 11, which is an example of hardware, and can be executed as each functional unit included in the control unit 11. These will be described in more detail in the next section. Note that the control unit 11 is not limited to being single, and the server device 10 may have multiple control units 11 for each function. Alternatively, a combination of these may be used.

[0019] <Storage section 12> The memory unit 12 stores various pieces of information defined above. This can be implemented, for example, as a storage device such as a solid state drive (SSD) that stores various programs and the like related to the server device 10 executed by the control unit 11, or as a memory such as a random access memory (RAM) that stores temporarily required information (arguments, arrays, etc.) related to the program operations. The memory unit 12 stores various programs, variables, etc. related to the server device 10 executed by the control unit 11.

[0020] <Communications Department 13> The communication unit 13 is preferably a wired communication means such as USB, IEEE1394, Thunderbolt (registered trademark), or wired LAN network communication, but may also include wireless LAN network communication, mobile communication such as 3G / LTE / 5G, or BLUETOOTH (registered trademark) communication as needed. That is, it is more preferable to implement it as a collection of multiple communication means. That is, the server device 10 may communicate various information from the outside via the communication unit 13 and the network.

[0021] The server device 10 may be an on-premise server or a cloud server. The cloud server device 10 may provide the above-described functions and processes in the form of, for example, SaaS (Software as a Service) or cloud computing.

[0022] <User terminal 20> The user terminal 20 is an information processing terminal used by a user who wishes to adjust the impression of an existing space or design a new space. FIG. 3 is a block diagram showing the hardware configuration of the user terminal 20. As shown in FIG. 3, the user terminal 20 includes a control unit 21, a memory unit 22, a communication unit 23, an input unit 24, an output unit 25, and a communication bus 26. The control unit 21, the memory unit 22, the communication unit 23, the input unit 24, and the output unit 25 are electrically connected via the communication bus 26 inside the user terminal 20. The description of the control unit 21, the memory unit 22, and the communication unit 23 is omitted because they are the same as the description of each unit in the server device 10.

[0023] <Input section 24> The input unit 24 accepts operation inputs made by the user. The operation inputs are transferred as command signals to the control unit 21 via the communication bus 26. The control unit 21 can execute predetermined control or calculations based on the transferred command signals as necessary. The input unit 24 may be included in the housing of the user terminal 20 or may be attached externally. For example, the input unit 24 may be implemented as a touch panel integrated with the output unit 25. When the input unit 24 is implemented as a touch panel, the user can input tap operations, swipe operations, etc. to the input unit 24. Instead of a touch panel, a switch button, a mouse, a trackpad, a QWERTY keyboard, etc. can be used as the input unit 24.

[0024] <Output section 25> The output unit 25 displays a screen of a graphical user interface (GUI) that can be operated by the user. The output unit 25 may be included in the housing of the user terminal 20 or may be attached externally. Specifically, the output unit 25 may be implemented as a display device such as a CRT display, a liquid crystal display, an organic EL display, or a plasma display. It is preferable that these display devices are used appropriately depending on the type of user terminal 20.

[0025] 2. Functional configuration This section describes the functional configuration of this embodiment. Information processing by software stored in the storage unit 12 is specifically realized by the control unit 11, which is an example of hardware, and can be executed as each functional unit included in the control unit 11 (a processor provided in the information processing system 1).

[0026] FIG. 4 is a block diagram showing functions realized by the server device 10 (controller 11) and the user terminal 20 (controller 21).

[0027] 4A, the server device 10 (control unit 11) includes a display control unit 111, an image acquisition unit 112, an initial prediction unit 113, a reception unit 114, a space image preparation unit 115, a selection unit 116, an impression prediction unit 117, an image presentation unit 118, a purchase method presentation unit 119, and an artificial intelligence unit 120. As shown in FIG. 4B, the user terminal 20 (control unit 21) includes a display unit 211 and an operation acquisition unit 212.

[0028] <Display control unit 111> The display control unit 111 is configured to display various information on the user terminal 20. For example, the display control unit 111 displays, on the output unit 25 of the user terminal 20, the impression adjustment items selected by the selection unit 116, the images created by the image presentation unit 118, and the like.

[0029] <Image Acquisition Unit 112> The image acquisition unit 112 is configured to acquire an initial image of an existing space that is the target of impression adjustment. Specifically, if the existing space is a real space, the image acquisition unit 112 acquires a photograph of the real space from the user terminal 20 or another server on the network. Furthermore, if the existing space is not a real space such as a virtual space or an image of space, the image acquisition unit 112 acquires a two-dimensional image of the space from the user terminal 20 or another server on the network. The user specifies the initial image to be acquired by the image acquisition unit 112 by selecting or uploading the initial image on the user terminal 20. Note that the data uploaded by the user may be a video. In this case, the image acquisition unit 112 extracts and acquires the initial image as a still image from the video.

[0030] It should be noted that if the target of impression adjustment is not an existing space but a new space (a space to be designed and constructed in the future), the image acquisition unit 112 does not acquire an initial image.

[0031] The types of existing spaces and new spaces are not particularly limited, and the targets for impression adjustment can include interior spaces of buildings (offices, homes, stores, public facilities, etc.), outdoor spaces (parks, gardens, etc.), interior spaces of vehicles (automobiles, aircraft, ships, etc.), etc. Furthermore, the existing spaces and new spaces may be real spaces or virtual spaces.

[0032] <Initial prediction unit 113> The initial prediction unit 113 is configured to predict an initial impression value of the existing space based on the initial image acquired by the image acquisition unit 112 and the first reference information. The initial impression value is the impression value of the existing space before the impression is adjusted by an impression adjustment item, which will be described later.

[0033] An "impression value" is a numerical representation of the impression (stimulus) a person feels from an object. The impression value may be a scalar or a multidimensional vector, as long as it can quantitatively express the impression felt by the user. As the impression value, two-dimensional vector data having two axes, valence and arousal, is preferable. By expressing the impression on two axes, valence and arousal, the user's impression can be accurately quantified while limiting the amount of information.

[0034] The first reference information is data including a correlation between an initial image and an initial impression value. The first reference information is stored, for example, in the storage unit 12. The first reference information is an estimator constructed so as to be able to input an image and output an impression value of the image. The first reference information may include, for example, a table, a function, a simple algorithm, or the like, which indicates a correlation between a feature extracted from the initial image (for example, vector data obtained by vectorizing an image) and the impression value. Such a correlation included in the first reference information can be constructed, for example, by statistically analyzing data recording an image and its impression value.

[0035] The first reference information may include an impression value prediction model that has been trained to be able to input an initial image and output an initial impression value. In this case, the initial prediction unit 113 inputs the initial image to the impression value prediction model of the artificial intelligence unit 120 and causes the impression value prediction model to output an initial impression value. According to this embodiment, it becomes possible to predict impression values ​​based on the results of measuring impression values ​​in a large number of spaces, thereby improving the accuracy of impression value prediction.

[0036] The impression value prediction model is a learning model that has been trained so as to be able to generically input an unspecified image and output the impression value of that image. The impression value prediction model is a learning model that has been trained using a combination of learning images and impression values ​​measured for those images (quantified impressions of multiple subjects who viewed the images) as training data. In the impression value prediction model, parameters calculated, tuned, etc. by learning constitute the correlation of the first reference information.

[0037] The initial prediction unit 113 may present the impression prediction value to the user before the desired impression value is received by the receiving unit 114, which will be described later. For example, the initial prediction unit 113 displays the impression prediction value on the user terminal 20 in the form of a numerical value (for example, a combination of valence and arousal), a graph showing the numerical value, a keyword corresponding to the numerical value, or the like.

[0038] When the new space is a target for impression adjustment, the initial prediction unit 113 does not predict the initial impression value.

[0039] <Reception Department 114> The reception unit 114 is configured to receive, from the user terminal 20, an input of a desired impression value that represents the impression desired for an existing space or a new space that is newly generated. The "desired impression value" refers to the impression value of the entire existing space or the entire new space in a state in which impression adjustment items, which will be described later, are arranged. For example, if the impression value handled by the control unit 11 has two axes, valence and arousal level, the desired impression value is composed of a combination of valence and arousal level.

[0040] When accepting input of a desired impression value for an existing space, the accepting unit 114 may accept the input of the desired impression value (target value) directly, or may accept the input of a correction value for the current impression value (initial impression value) and accept the current impression value plus or minus the correction value as the desired impression value.

[0041] The receiving unit 114 may receive the desired impression value as a numerical input at the user terminal 20. For example, if the impression value is a combination of valence and arousal level (a two-dimensional vector), the receiving unit 114 may directly receive input of these two numerical values.

[0042] Furthermore, the receiving unit 114 may receive, from the user terminal 20, a selection of a keyword expressing an emotion, and receive a numerical value corresponding to the keyword as the desired impression value. According to this embodiment, the user can input a desired impression value based on their sensibility. For example, the receiving unit 114 may present, to the user terminal 20, a list of keywords to which predetermined impression values ​​have been set in advance, and receive, as the desired impression value, the impression value set for the keyword selected by the user. Furthermore, the receiving unit 114 may present, to the user terminal 20, a map (graph) showing the distribution of keywords, and receive an input of a selection of map coordinates. In this case, the map coordinates (the position selected by the user) correspond to the keyword expressing an emotion, and the receiving unit 114 receives the selected map coordinates (for example, a two-dimensional vector) as the desired impression value.

[0043] FIG. 5 is a diagram showing an example of a map showing the distribution of keywords displayed on the user terminal 20. In the example of FIG. 5, Russell's emotional circumplex model is used as the map. In the map of FIG. 5, the horizontal axis represents valence, and the vertical axis represents arousal. When the user selects any position on the map by performing an input operation on the user terminal 20, the numerical value on the horizontal axis of the map coordinates is converted into the valence of the desired impression value, and the numerical value on the vertical axis of the map coordinates is converted into the arousal level of the desired impression value. For example, if the user desires an impression of "energetic" for a space, the coordinates on the map near "energetic" are selected. The receiving unit 114 acquires the valence and arousal level of the desired impression value based on the coordinates.

[0044] The receiving unit 114 may receive both a numerical value input and an input by selecting a keyword that expresses an emotion for the desired impression value. That is, the receiving unit 114 may receive an input by an input means selected by the user from among the input means for inputting a numerical value and a keyword.

[0045] When performing impression adjustment of an existing space (that is, when an initial impression value has been predicted by the initial prediction unit 113), the reception unit 114 may present the predicted initial impression value and also receive an input of a desired impression value. According to this aspect, the user can grasp the impression of the existing space and then set the impression value of the impression.

[0046] In the user terminal 20, the initial impression value may be displayed as a numerical value (for example, a combination of emotional valence and arousal), or may be displayed as a keyword indicating an emotion corresponding to the initial impression value, or may be displayed as a coordinate on a map showing the distribution of keywords indicating emotions (for example, the map shown in FIG. 5).

[0047] When presenting the initial impression value, the receiving unit 114 may receive input of a desired correction value (amount of correction of the impression value from the initial impression value) from the user terminal 20, or may receive input of a desired impression value (impression value after adjustment) from the user terminal 20.

[0048] On the other hand, when adjusting the impression of a new space, the receiving unit 114 may receive input of the specifications of the new space along with the desired impression value of the new space. The "specifications of the new space" may include, for example, dimensions, number of occupants, incidental facilities, and purpose. Required items and non-required items may be set in advance in the specifications of the new space. Furthermore, the receiving unit 114 may present a plurality of pre-prepared new space templates to the user terminal 20 and receive the specifications of a template selected by the user as the specifications input by the user.

[0049] <Spatial Image Preparation Unit 115> The space image preparation unit 115 is configured to prepare an image of the new space in which impression adjustment items, which will be described later, are not arranged when impression adjustment of the new space is performed.

[0050] For example, the space image preparation unit 115 uses a space formation algorithm prepared in advance to generate an image (e.g., a two-dimensional image) of a virtual space that satisfies the specifications received by the reception unit 114. Furthermore, when the reception unit 114 receives input of a template for a new space, the space image preparation unit 115 acquires an existing space image corresponding to the template. The image of the new space prepared by the space image preparation unit 115 is used to predict the initial impression value of the new space and to present an image of the new space after the impression adjustment items have been placed.

[0051] Furthermore, the space image preparation unit 115 predicts the initial impression value of the new space based on the image of the new space and second reference information. The second reference information is data including the correlation between the image of the new space and the initial impression value. The second reference information is stored in the storage unit 12, for example.

[0052] The second reference information may be the same as or different from the first reference information used by the initial prediction unit 113 (i.e., for predicting the initial impression value of the existing space). For example, the space image preparation unit 115 may input an image of the new space to an impression value prediction model of the artificial intelligence unit 120 and cause the impression value prediction model to output an initial impression value.

[0053] Furthermore, when the receiving unit 114 receives input of a template for a new space, the space image preparing unit 115 may acquire the (pre-calculated) impression value included in the template in advance as the initial impression value of the new space.

[0054] When the impression of an existing space is to be adjusted, the space image preparation unit 115 does not prepare an image.

[0055] <Selection section 116> The selection unit 116 is configured to select impression adjustment items that are recommended for placement in an existing space or a new space, based on the desired impression value received by the reception unit 114 and the impression adjustment value of each impression adjustment item included in a group of items prepared in advance. "Impression adjustment items" refer to items that can be placed in a space, and include furniture (tables, chairs, etc.), fixtures (baskets, cases, etc.), electrical equipment (lighting, monitors, speakers, etc.), plants, and decorations (paintings, ornaments, wallpaper, carpets, etc.). Note that when the target for impression adjustment is a space in a virtual space, the impression adjustment items are objects in the virtual space (for example, objects represented by a 3D model).

[0056] Among the items that can be placed in a space, items that have already been set with an impression adjustment value are registered as impression adjustment items in the "item group." The "impression adjustment value" is the impression value for a single impression adjustment item (or for an item that is made up of multiple items, the combination of multiple items), and is set using the same definition as the impression value of the space. Therefore, if the impression value of the space has two axes, emotional valence and arousal level, the impression adjustment value is made up of a combination of emotional valence and arousal level.

[0057] When an existing space is the target for impression adjustment, the selection unit 116 selects impression adjustment items that are recommended for placement in the existing space based on the desired impression value, the initial impression value of the existing space predicted by the initial prediction unit 113, and the impression adjustment value. According to this aspect, it is possible to present items for adjusting the existing space to the impression desired by the user.

[0058] Furthermore, when the new space is a target for impression adjustment, the selection unit 116 selects items recommended for placement in the new space based on the desired impression value, the initial impression value of the new space based on the specifications accepted by the acceptance unit 114, and the impression adjustment value. According to this embodiment, an image of the new space with the impression desired by the user can be presented together with the items.

[0059] For example, the selection unit 116 may select items so that the valence and arousal of the impression adjustment value combined with the valence and arousal of the existing space or new space before the impression adjustment item is placed approach the valence and arousal of the desired impression value, respectively. According to this aspect, it is possible to accurately propose a space that is close to the impression desired by the user.

[0060] FIG. 6 is a diagram for explaining the adjustment of impression values. In FIG. 6, the horizontal axis is set to emotional valence and the vertical axis is set to arousal level, and the diagram shows the initial impression value I0 (the impression value of the existing space or new space before the impression adjustment item is placed) and the desired impression value I1 input by the user. The selection unit 116 selects an impression adjustment item having an impression adjustment value that fills the difference between the initial impression value I0 and the desired impression value I1 (in other words, corresponding to a vector starting from the initial impression value I0 and ending at the desired impression value I1). In the example of the combination of the initial impression value I0 and the desired impression value I1 in FIG. 6, the selection unit 116 selects an impression adjustment item that increases the arousal value by a predetermined amount and also increases the emotional value by a predetermined amount. In the example of the combination of the initial impression value I0 and the desired impression value I2 in FIG. 6, the selection unit 116 selects an impression adjustment item that decreases the arousal value by a predetermined amount and increases the emotional value by a predetermined amount.

[0061] The selection unit 116, for example, references a table in which identification information (e.g., name, ID, etc.) of impression adjustment items is linked to the impression adjustment amounts of the impression adjustment items, and extracts impression adjustment items to be presented to the user from a group of items included in the table. The selection unit 116 may also select multiple impression adjustment items.

[0062] The impression adjustment amount of an impression adjustment item may be an impression value (a numerical representation of the impressions of multiple subjects) measured for the impression adjustment item (or an image thereof), or may be output by the impression value prediction model by inputting an image of the impression adjustment item into the impression value prediction model.

[0063] The impression-adjusting item may be a plant or a decorative item imitating a plant. According to this embodiment, the impression of an existing space or a new space can be easily and accurately adjusted. In particular, since the emotional value and arousal level of plants vary greatly depending on the type of plant, by selecting an appropriate plant species, it is possible to adjust the impression to a desired level without impairing the functionality of the space. Examples of "decorative items imitating plants" include artificial plants (fake greenery, artificial flowers, etc.), wallpaper, panels, carpets, covers, etc., printed with all or part of a plant.

[0064] <Impression Prediction Section 117> The impression prediction unit 117 is configured to generate an item arrangement image in which the impression adjustment items selected by the selection unit 116 are arranged in an existing space or a new space, and to predict an adjusted impression value of the existing space or the new space based on the item arrangement image and the third reference information. According to this aspect, item selection can be repeated based on the impression values ​​after the items are arranged, thereby improving the accuracy of item selection.

[0065] The "item arrangement image" is generated, for example, by superimposing an image of the selected impression adjustment item on the initial image acquired by the image acquisition unit 112 (when the existing space is the target of impression adjustment) or on the image of the new space created by the space image preparation unit 115 (when the new space is the target of impression adjustment). Also, if multiple impression adjustment items are selected by the selection unit 116, the impression prediction unit 117 generates an item arrangement image in which the multiple impression adjustment items are arranged.

[0066] Fig. 7 is a diagram showing an example of an item arrangement image AI created by the impression prediction unit 117. The item arrangement image AI in Fig. 7 is an example of an image in which an impression adjustment item CI, which is wallpaper, is arranged in an existing or initial state space SP. The item arrangement image in Fig. 7 is created by compositing the impression adjustment item CI with an image (initial image or image of a new space) before the impression adjustment item CI is arranged in the item arrangement image AI (before the wallpaper is composited).

[0067] The placement location of the impression adjustment item in the target space for impression adjustment is determined by the impression prediction unit 117, for example, according to the attribute of the impression adjustment item that has been set in advance. For example, if the attribute of the impression adjustment item is "potted plant," the impression prediction unit 117 places the impression adjustment item on the floor of the space in a position that does not interfere with other equipment. Also, for example, if the attribute of the impression adjustment item is "wallpaper," the impression prediction unit 117 places the impression adjustment item so that it overlaps with the wall of the space. Furthermore, the impression prediction unit 117 may receive input from the user terminal 20 to adjust the position of the impression adjustment item or specify the position.

[0068] The third reference information is data including a correlation between an item arrangement image and an adjusted impression value. The third reference information is stored, for example, in the storage unit 12. The third reference information may be the same as or different from the first reference information used by the initial prediction unit 113 (i.e., for predicting the initial impression value of the existing space).

[0069] The third reference information may include an impression value prediction model that has been trained so as to be able to input an item arrangement image and output an adjusted impression value. In this case, the impression prediction unit 117 inputs the item arrangement image to the impression value prediction model of the artificial intelligence unit 120 and causes the impression value prediction model to output an adjusted impression value. According to this embodiment, it becomes possible to predict impression values ​​based on the measurement results of impression values ​​in a large number of spaces, thereby improving the accuracy of impression value prediction.

[0070] The impression value prediction model used by impression prediction unit 117 may be the same as that used by the above-mentioned initial prediction unit 113 and spatial image preparation unit 115. However, the impression prediction model used by impression prediction unit 117 (a learning model included in the third reference information and outputting an adjusted impression value) and the impression prediction model used by initial prediction unit 113 or spatial image preparation unit 115 (a learning model included in the first reference information or the second reference information and outputting an initial impression value) may each be learned separately.

[0071] The impression prediction unit 117 may cause the selection unit 116 to reselect impression adjustment items when the predicted adjusted impression values ​​do not satisfy a predetermined condition. The "predetermined condition" is, for example, a condition in which the difference between the desired impression value and the adjusted impression value is equal to or less than a predetermined threshold. When the selection unit 116 reselects impression adjustment items, the impression prediction unit 117 regenerates an item arrangement image in which the reselected impression adjustment items are arranged, and re-predicts the adjusted impression values ​​of the item arrangement image. Furthermore, the impression prediction unit 117 determines whether the newly predicted adjusted impression values ​​satisfy the predetermined condition. The impression prediction unit 117 repeats the arrangement of impression adjustment items and the generation of item arrangement images until the adjusted impression values ​​satisfy the predetermined condition.

[0072] <Image presentation unit 118> The image presenting unit 118 is configured to present to the user the item arrangement image generated by the impression predicting unit 117. Specifically, the image presenting unit 118 causes the user terminal 20 to display the item arrangement image generated by the impression predicting unit 117 and whose adjusted impression value satisfies a predetermined condition.

[0073] The image presenting unit 118 may display the adjusted impression value together with the item arrangement image on the user terminal 20. The adjusted impression value may be displayed as a numerical value (for example, a combination of emotional valence and arousal level), or may be displayed in the form of a graph showing the numerical value, a keyword corresponding to the numerical value, or the like. In addition, the image presenting unit 118 may display information about the impression adjustment item included in the item arrangement image (for example, name, function, product number, price, etc.) on the user terminal 20.

[0074] <Purchase Method Presentation Section 119> The purchase method presentation unit 119 presents to the user a method for purchasing the impression adjustment item included in the item arrangement image presented by the image presentation unit 118. According to this embodiment, the user can confirm the image of the items arranged in space and then decide whether to purchase the item. Furthermore, since the user can purchase the item on the spot, usability is improved.

[0075] For example, the purchasing method presentation unit 119 receives from the user terminal 20 whether or not to accept the presented item arrangement image. If the item arrangement image is accepted by the user, the purchasing method presentation unit 119 presents to the user terminal 20 a link (URL) to a purchasing site (EC site) for the impression adjustment item included in the item arrangement image.

[0076] Furthermore, the purchase method presentation unit 119 may accept input of purchase instructions for individual impression adjustment items included in the item arrangement image from the user terminal 20. Purchase instructions for impression adjustment items are accepted, for example, by input operations on the image of the impression adjustment item itself in the item arrangement image, or on an icon (for example, a purchase button) attached to the impression adjustment item, or on a purchase button presented in an information display field for the impression adjustment item presented together with the item arrangement image.

[0077] When the purchase method presentation unit 119 receives a purchase instruction from the user terminal 20, it presents a link (URL) to a purchase site for the selected impression adjustment item to the user terminal 20. The purchase method presentation unit 119 may also cause the user terminal 20 to access the purchase site for the selected impression adjustment item and transition the display screen of the user terminal 20 to that purchase site. Furthermore, the purchase method presentation unit 119 may also directly accept a purchase of an impression adjustment item from the user terminal 20.

[0078] The user performs an operation to purchase the impression adjustment item on the presented purchase site or on the purchase screen presented by the purchase method presentation unit 119.

[0079] <Artificial Intelligence Department 120> The artificial intelligence unit 120 is configured to receive input from each functional unit and return the instructed output. The artificial intelligence used by the server device 10 in each functional unit may be a common one, or may be prepared individually for each functional unit.

[0080] The artificial intelligence unit 120 may include a learning model such as a language model including a generative AI, such as a Transformer or a Recurrent Neural Network (RNN).

[0081] The language model is an example of a learning model based on a machine learning algorithm. Specific examples of machine learning algorithms include nearest neighbor methods, naive Bayes methods, decision trees, support vector machines, and deep learning using neural networks. The artificial intelligence unit 120 can apply the above algorithms as appropriate.

[0082] The artificial intelligence unit 120 may have a trained model constructed by a learning method such as supervised learning, unsupervised learning, or self-supervised learning. In supervised learning, machine learning is performed using training data (training data). The training data consists of pairs of input data for learning and output data (correct answer data). Furthermore, the language model may not only be trained for a specific task, but may also be a general-purpose model that can be used for a wide range of tasks. The learning model included in the artificial intelligence unit 120 can undergo additional training as transfer learning or fine tuning.

[0083] <Display section 211> The display unit 211 of the user terminal 20 is configured to display on the output unit 25 a screen indicated by the screen data transmitted from the server device 10.

[0084] <Operation acquisition unit 212> The operation acquisition unit 212 of the user terminal 20 is configured to accept operations by the user of the user terminal 20.

[0085] 3. Information Processing Method This section describes an information processing method of the server device 10. This information processing method is executed by a computer, with each unit of the server device 10 acting as each step.

[0086] The information processing method of the first embodiment (when adjusting the impression of an existing space) includes an image acquisition step, an initial prediction step, a reception step, a selection step, an impression prediction step, an image presentation step, and a purchase method presentation step. In the image acquisition step, an initial image of the existing space is acquired. In the initial prediction step, an initial impression value of the existing space is predicted based on the initial image and reference information. In the reception step, input of a desired impression value that represents the impression desired for the existing space is accepted. In the selection step, items recommended for placement in the existing space or a new space are selected based on the desired impression value and the impression adjustment values ​​of each item included in a pre-prepared item group. In the impression prediction step, an item arrangement image in which the selected items are arranged in the existing space or the new space is generated, and an adjusted impression value of the existing space or the new space is predicted based on the item arrangement image and the reference information. In the image presentation step, the item arrangement image is presented to the user. In the purchase method presentation step, a method for purchasing items included in the item arrangement image is presented to the user.

[0087] 8 is an activity diagram showing a first pattern of the flow of information processing (processing for adjusting the impression of an existing space) according to the first embodiment, which is executed by the information processing system 1. Below, the information processing will be described along with each activity in this activity diagram.

[0088] The first pattern of impression adjustment processing for an existing space begins with acquiring an image of the target existing space. The user, for example, specifies an image of the existing space by taking a photo using the user terminal 20 and uploading it (activity A110). The server device 10 acquires the image specified from the user terminal 20 as an initial image (activity A120). Next, the server device 10 predicts an initial impression value of the initial image and outputs it to the user terminal 20 (activity A130). As a result, the initial impression value is displayed on the user terminal 20 (activity A140).

[0089] The user refers to the initial impression value and inputs a desired impression value into the user terminal 20 (activity A150). The server device 10 accepts the input desired impression value from the user terminal 20 (activity A160). Next, the server device 10 selects impression adjustment items using the desired impression value (activity A170). Next, the server device 10 generates an item arrangement image in which the selected impression adjustment items are arranged on the initial image (activity A180). Furthermore, the server device 10 predicts the adjusted impression value of the item arrangement image (activity A190).

[0090] The server device 10 determines whether the predicted adjusted impression value satisfies a predetermined condition (target value) (activity A200). If the adjusted impression value does not satisfy the condition, the server device 10 repeats the process from activity A170 (selection of impression adjustment items). If the adjusted impression value satisfies the condition, the server device 10 outputs an item arrangement image to the user terminal 20 (activity A210). As a result, the item arrangement image is displayed on the user terminal 20 (activity A220).

[0091] The user inputs into the user terminal 20 whether or not to accept the item arrangement image displayed on the user terminal 20 (activity A230). If the user does not accept (rejects) the presented item arrangement image, the user re-inputs the desired impression value in activity A150. In this case, the display screen of the user terminal 20 transitions from the display screen of the item arrangement image to a screen for inputting the desired impression value. If the user accepts the presented item arrangement image (if the server device 10 receives input of acceptance from the user terminal 20), the server device 10 presents a method for purchasing the adjusted impression item (activity A240). The user refers to the presented purchase method and purchases the adjusted impression item on the user terminal 20 (activity A250).

[0092] Fig. 9 is an activity diagram showing a second pattern of the flow of information processing (processing for adjusting the impression of an existing space) of the first embodiment, which is executed by the information processing system 1. The activity diagram of the second pattern in Fig. 9 is obtained by adding an image confirmation activity A260 in the user terminal 20 to the activity diagram of the first pattern in Fig. 8 (for this reason, some activities common to Fig. 8 are omitted in Fig. 9).

[0093] In activity A260, the user checks the initial impression value displayed on user terminal 20 and decides whether or not to change the image of the existing space. If the image is to be changed, the user performs an input operation to change the image on user terminal 20 and re-specifies the image for activity A110. In this case, the display screen of user terminal 20 transitions from the initial impression value display screen to an image specification screen. If the image is not to be changed, the user inputs a desired impression value for activity A150 on user terminal 20.

[0094] The information processing method of the second embodiment (when performing impression adjustment of a new space) includes a receiving step, a selection step, an impression prediction step, an image presentation step, and a purchase method presentation step. In the receiving step, input of the specifications of the new space along with the desired impression value of the new space is accepted. In the selection step, items recommended for placement in the existing space or the new space are selected based on the desired impression value and the impression adjustment values ​​of each item included in a pre-prepared item group. In the impression prediction step, an item arrangement image in which the selected items are arranged in the existing space or the new space is generated, and an adjusted impression value of the existing space or the new space is predicted based on the item arrangement image and reference information. In the image presentation step, the item arrangement image is presented to the user. In the purchase method presentation step, a method for purchasing the items included in the item arrangement image is presented to the user.

[0095] 10 is an activity diagram showing the flow of information processing (design processing of a new space) according to the second embodiment, which is executed by the information processing system 1. The information processing will be described below along with each activity in this activity diagram.

[0096] The design process for a new space begins with receiving the specifications and desired impression values ​​of the new space. The user inputs the specifications and desired impression values ​​of the new space into the user terminal 20 (activity A310). The server device 10 receives the input specifications and desired impression values ​​from the user terminal 20 (activity A320). Next, the server device 10 prepares an image of the new space based on the specifications (activity A330). Furthermore, the server device 10 predicts the initial impression value of the image (activity A340).

[0097] The server device 10 executes activities similar to the activities A170-A250 in the activity diagram of FIG. 8 using the initial impression value of the initial space predicted from the image.

[0098] 4. Effect The operation of this embodiment can be summarized as follows: That is, the user can select items for constructing a space with a desired impression, and as a result, the impression of the space can be adjusted by the selected items.

[0099] Although the embodiment of the present invention has been described above, the present invention is not limited to this and can be modified as appropriate within the scope of the technical idea of ​​the invention.

[0100] 5.Other In the above embodiment, the server device 10 performs various storage and control operations. However, multiple external devices may be used instead of the server device 10. That is, various information and programs may be distributed and stored in multiple external devices using blockchain technology or the like. In particular, the artificial intelligence unit 120 may be an external component of the server device 10.

[0101] The aspect of this embodiment is not limited to the information processing system 1, and may be an information processing method or a program. The information processing method includes steps executed by the information processing system 1. The program causes a computer to execute the steps of the information processing system 1.

[0102] At least one of the devices included in the information processing system 1 may be installed outside the country in which the functions of the information processing system 1 are performed.

[0103] The information processing system 1 may be an integrated system of the server device 10 and the user terminal 20. For example, the user terminal 20 may perform processes such as prediction of impression values ​​and selection of impression adjustment items. In other words, the user terminal 20 may be an information processing device that performs impression adjustment of a space.

[0104] It may be provided in the following manner.

[0105] (1) An information processing system comprising a processor configured to execute the following steps by reading a program: a reception step of receiving an input of a desired impression value representing the impression desired for an existing space or a new space to be newly generated; and a selection step of selecting the items recommended for placement in the existing space or the new space based on the desired impression value and the impression adjustment value of each item included in a group of items prepared in advance.

[0106] According to this aspect, the user can select items to configure a space with a desired impression, and as a result, the impression of the space can be adjusted by the selected items.

[0107] (2) In the information processing system described in (1) above, the desired impression value and the impression adjustment value are each composed of a combination of valence and arousal, and in the selection step, the item is selected so that the valence and arousal of the impression adjustment value combined with the valence and arousal of the existing space or the new space before the item is placed are close to the valence and arousal of the desired impression value.

[0108] According to this aspect, it is possible to accurately propose a space that is close to the impression desired by the user.

[0109] (3) In the information processing system described in (1) or (2) above, the item is a plant or an ornament that resembles a plant.

[0110] According to this aspect, the impression of an existing space or a new space can be easily and accurately adjusted.

[0111] (4) In the information processing system according to any one of (1) to (3) above, in the receiving step, a selection of a keyword expressing an emotion is received, and a numerical value corresponding to the keyword is received as the desired impression value.

[0112] According to this aspect, the user can input a desired impression value based on his or her sensibility.

[0113] (5) In the information processing system described in any one of (1) to (4) above, the processor is configured to further execute the following steps: in the impression prediction step, an item arrangement image in which the selected items are arranged in the existing space or the new space is generated, and an adjusted impression value of the existing space or the new space is predicted based on the item arrangement image and reference information, wherein the reference information includes a correlation between the item arrangement image and the adjusted impression value.

[0114] According to this aspect, the selection of items can be repeated based on the impression values ​​after the items are placed, thereby improving the accuracy of the selection of items.

[0115] (6) In the information processing system described in (5) above, the reference information includes an impression value prediction model that has been trained to be able to input the item arrangement image and output the adjusted impression value, and in the impression prediction step, the item arrangement image is input to the impression value prediction model, and the impression value prediction model is caused to output the adjusted impression value.

[0116] According to this aspect, it is possible to predict impression values ​​based on the results of measuring impression values ​​in a large number of spaces, thereby improving the accuracy of the prediction of impression values.

[0117] (7) In the information processing system described in (5) or (6) above, the processor is configured to further perform the following steps: in the image presentation step, presenting the item placement image to the user; and in the purchase method presentation step, presenting to the user a method for purchasing the item included in the item placement image.

[0118] According to this aspect, the user can check the image of the items arranged in the space before deciding whether to purchase the items. Furthermore, since the user can purchase the items on the spot, usability is improved.

[0119] (8) In the information processing system described in any one of (1) to (7) above, the processor is configured to further execute the following steps: in the image acquisition step, an initial image of the existing space is acquired; in the initial prediction step, an initial impression value of the existing space is predicted based on the initial image and reference information, wherein the reference information includes a correlation between the initial image and the initial impression value; and in the reception step, the predicted initial impression value is presented and an input of the desired impression value is received.

[0120] According to this aspect, the user can set a desired impression value after grasping the impression of the existing space.

[0121] (9) In the information processing system described in any one of (1) to (7) above, in the reception step, input of specifications for the new space along with the desired impression value of the new space is received, and in the selection step, the items recommended for placement in the new space are selected based on the desired impression value, the initial impression value of the new space, and the impression adjustment value.

[0122] According to this aspect, an image of a new space that gives the impression desired by the user can be presented together with the items.

[0123] (10) An information processing method, comprising steps executed by the information processing system according to any one of (1) to (9) above.

[0124] (11) A program for causing a computer to execute each step of the information processing system described in any one of (1) to (9) above. Of course, this is not the case. [Explanation of symbols]

[0125] 1: Information processing system 2: Communication line 10: Server device 11: Control section 12: Storage section 13: Communications Department 14: Communication bus 20: User terminal 21: Control unit 22: Storage section 23: Communications Department 24: Input section 25: Output section 26: Communication bus 111: Display control unit 112: Image acquisition unit 113: Initial prediction section 114: Reception 115: Spatial image preparation section 116: Selection Department 117: Impression Prediction Department 118: Image presentation unit 119: Purchase method presentation section 120: Artificial Intelligence Department 211: Display section 212: Operation acquisition section AI: Item placement image CI: Impression adjustment items SP: space

Claims

1. An information processing system, a processor; The processor is configured to execute the following steps by reading the program: In the reception step, input of a desired impression value that represents the desired impression of an existing space or a new space to be generated is received, In the selection step, the information processing system selects the items recommended for placement in the existing space or the new space based on the desired impression value and the impression adjustment value of each item included in a pre-prepared group of items.

2. 2. The information processing system according to claim 1, the desired impression value and the impression adjustment value are each composed of a combination of emotional valence and arousal level, In the selection step, the information processing system selects the items so that the emotional valence and arousal level of the existing space or the new space before the items are placed combined with the emotional valence and arousal level of the impression adjustment value are close to the emotional valence and arousal level of the desired impression value, respectively.

3. 2. The information processing system according to claim 1, An information processing system, wherein the item is a plant or an ornament that resembles a plant.

4. 2. The information processing system according to claim 1, In the receiving step, a selection of a keyword expressing an emotion is received, and a numerical value corresponding to the keyword is received as the desired impression value.

5. 2. The information processing system according to claim 1, The processor is further configured to perform the steps of: In the impression prediction step, an item arrangement image in which the selected items are arranged in the existing space or the new space is generated, and an adjusted impression value of the existing space or the new space is predicted based on the item arrangement image and reference information; Here, the reference information includes a correlation between the item arrangement image and the adjusted impression value.

6. 6. The information processing system according to claim 5, the reference information includes an impression value prediction model that has been trained to receive the item arrangement image as an input and output the adjusted impression value, In the impression prediction step, the item arrangement image is input to the impression value prediction model, and the impression value prediction model is caused to output the adjusted impression value.

7. 6. The information processing system according to claim 5, The processor is further configured to perform the steps of: In the image presenting step, the item arrangement image is presented to a user; In the purchase method presenting step, a method for purchasing the item included in the item arrangement image is presented to the user.

8. 2. The information processing system according to claim 1, The processor is further configured to perform the steps of: In the image acquisition step, an initial image of the existing space is acquired; In the initial prediction step, an initial impression value of the existing space is predicted based on the initial image and reference information; wherein the reference information includes a correlation between the initial image and the initial impression value, In the receiving step, the predicted initial impression value is presented and an input of the desired impression value is received.

9. 2. The information processing system according to claim 1, In the receiving step, input of the desired impression value of the new space and specifications of the new space is received, In the selection step, the information processing system selects the items recommended for placement in the new space based on the desired impression value, the initial impression value of the new space, and the impression adjustment value.

10. An information processing method, comprising: An information processing method comprising the steps executed by the information processing system according to any one of claims 1 to 9.

11. A program, A program for causing a computer to execute each step of the information processing system according to any one of claims 1 to 9.

Images