Information processing system, information processing method, and program

Abstract

[Problem] To provide, inter alia, an information processing system whereby the impression of a space can be adjusted. [Solution] According to one aspect of the present invention, provided is an information processing system provided with a processor. The processor is configured so as to execute the following steps by reading a program. In a reception step, received is an input of a desired impression value representing the desired impression of an existing space or newly-generated new space. In a selection step, an item recommended for arrangement in the existing space or new space is selected on the basis of the desired impression value and impression adjustment values of items included in an item group that has been prepared in advance.

Description

Information processing system, information processing method and program

[0001] The present invention relates to an information processing system, an information processing method, and a program.

[0002] As disclosed in Patent Document 1, an apparatus for generating an image with an adjusted impression is known.

[0003] Japanese Patent Application Laid-Open No. 2023-154753

[0004] The above-mentioned system can design an image based on an impression, but does not anticipate adjusting the impression for a space.

[0005] In view of the above circumstances, the present invention provides an information processing system and the like that can adjust the impression of a space.

[0006] According to one aspect of the present invention, there is provided an information processing system including a processor configured to execute the following steps by reading a program: in a reception step, an input of a desired impression value representing the impression desired for an existing space or a new space to be newly generated is received; and in a selection step, an item recommended for placement in the existing space or the new space is selected based on the desired impression value and the impression adjustment value of each item included in a pre-prepared item group.

[0007] According to this aspect, the user can select items to configure a space with a desired impression, and as a result, the impression of the space can be adjusted by the selected items.

[0008] 1 is a configuration diagram illustrating an information processing system 1. FIG. 1 is a block diagram illustrating the hardware configuration of a server device 10. FIG. 2 is a block diagram illustrating the hardware configuration of a user terminal 20. FIG. 3 is a block diagram illustrating functions implemented by the server device 10 (control unit 11) and the user terminal 20 (control unit 21). FIG. 4 is a diagram illustrating an example of a map showing the distribution of keywords displayed on the user terminal 20. FIG. 5 is a diagram for explaining adjustment of impression values. FIG. 6 is a diagram illustrating an example of an item arrangement image AI created by an impression prediction unit 117. FIG. 7 is an activity diagram illustrating a first pattern of the flow of information processing (impression adjustment processing of an existing space) of the first embodiment, which is executed by the information processing system 1. FIG. 8 is an activity diagram illustrating a second pattern of the flow of information processing (impression adjustment processing of an existing space) of the first embodiment, which is executed by the information processing system 1. FIG. 9 is an activity diagram illustrating the flow of information processing (design processing of a new space) of a second embodiment, which is executed by the information processing system 1.

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below with reference to the accompanying drawings. Various features shown in the following embodiments can be combined with each other.

[0010] Incidentally, a program for realizing the software appearing in one embodiment may be provided as a non-transitory computer-readable recording medium, or may be provided so as to be downloadable from an external server, or may be provided so that the program is started on an external computer and its functions are realized on a client terminal (so-called cloud computing).

[0011] Furthermore, various information processing according to an embodiment may realize input and output corresponding to the input. Here, the form of information referenced in such information processing (hereinafter referred to as reference information) is not limited as long as an output is obtained as a result of the input. The reference information may be, for example, rule-based information such as a database, a lookup table, or a predetermined function (including a decision formula such as a regression formula constructed using a statistical method), a trained model that has previously trained the correlation between input and output, or a large-scale language model that can output a desired result by inputting a prompt.

[0012] In one embodiment, the term "unit" may include, for example, a combination of hardware resources implemented by a circuit in the broad sense and software information processing that can be specifically realized by these hardware resources. In one embodiment, various information is handled, and this information is represented, for example, by physical values ​​of signal values ​​representing voltage or current, high or low signal values ​​as a binary bit set consisting of 0 or 1, or quantum superposition (so-called quantum bits), and communication and calculations can be performed on the circuit in the broad sense.

[0013] Furthermore, a circuit in a broad sense is a circuit realized by at least an appropriate combination of a circuit, circuitry, a processor, a memory, etc. The processor may be a general-purpose processor or a dedicated circuit. That is, it includes application specific integrated circuits (ASICs), programmable logic devices (e.g., simple programmable logic devices (SPLDs), complex programmable logic devices (CPLDs), and field programmable gate arrays (FPGAs)), etc.

[0014] 1. Hardware Configuration This section explains the hardware configuration.

[0015] <Information Processing System 1> Fig. 1 is a configuration diagram showing an information processing system 1. The information processing system 1 includes a communication line 2, a server device 10 (an example of an information processing device), and a plurality of user terminals 20. The server device 10 and the user terminals 20 are configured to be able to communicate with each other via the communication line 2. The connection between the server device 10 and the user terminals 20 may be wired or wireless.

[0016] In one embodiment, the information processing system 1 comprises one or more devices or components, which will now be described.

[0017] <Server Device 10> Fig. 2 is a block diagram showing the hardware configuration of the server device 10. As shown in Fig. 2, the server device 10 includes a control unit 11, a storage unit 12, a communication unit 13, and a communication bus 14. The control unit 11, the storage unit 12, and the communication unit 13 are electrically connected via the communication bus 14 inside the server device 10.

[0018] <Control Unit 11> The control unit 11 processes and controls the overall operations related to the server device 10. The control unit 11 is, for example, a central processing unit (CPU). The control unit 11 realizes various functions related to the server device 10 by reading out predetermined programs stored in the storage unit 12. In other words, information processing by software stored in the storage unit 12 is specifically realized by the control unit 11, which is an example of hardware, and can be executed as each functional unit included in the control unit 11. These will be described in more detail in the next section. Note that the control unit 11 is not limited to being single, and the server device 10 may have multiple control units 11 for each function. Alternatively, a combination of these may be used.

[0019] <Storage Unit 12> The storage unit 12 stores various pieces of information defined above. This may be implemented, for example, as a storage device such as a solid state drive (SSD) that stores various programs and the like related to the server device 10 executed by the control unit 11, or as a memory such as a random access memory (RAM) that stores temporarily required information (arguments, arrays, etc.) related to the program calculations. The storage unit 12 stores various programs, variables, etc. related to the server device 10 executed by the control unit 11.

[0020] <Communication Unit 13> The communication unit 13 is preferably a wired communication means such as USB, IEEE 1394, Thunderbolt (registered trademark), or wired LAN network communication, but may also include wireless LAN network communication, mobile communication such as 3G / LTE / 5G, or BLUETOOTH (registered trademark) communication as needed. In other words, it is more preferable to implement the communication unit 13 as a collection of multiple communication means. In other words, the server device 10 may communicate various information from the outside via the communication unit 13 and the network.

[0021] The server device 10 may be an on-premise server or a cloud server. The cloud server device 10 may provide the above-described functions and processes in the form of, for example, SaaS (Software as a Service) or cloud computing.

[0022] <User Terminal 20> The user terminal 20 is an information processing terminal used by a user who wants to adjust the impression of an existing space or design a new space. Fig. 3 is a block diagram showing the hardware configuration of the user terminal 20. As shown in Fig. 3, the user terminal 20 includes a control unit 21, a storage unit 22, a communication unit 23, an input unit 24, an output unit 25, and a communication bus 26. The control unit 21, the storage unit 22, the communication unit 23, the input unit 24, and the output unit 25 are electrically connected via the communication bus 26 inside the user terminal 20. The description of the control unit 21, the storage unit 22, and the communication unit 23 is omitted because they are the same as the description of each unit in the server device 10.

[0023] <Input Unit 24> The input unit 24 accepts operation inputs made by the user. The operation inputs are transferred as command signals to the control unit 21 via the communication bus 26. The control unit 21 can execute predetermined control or calculations based on the transferred command signals as necessary. The input unit 24 may be included in the housing of the user terminal 20 or may be externally attached. For example, the input unit 24 may be implemented as a touch panel integrated with the output unit 25. When the input unit 24 is implemented as a touch panel, the user can input tap operations, swipe operations, etc. to the input unit 24. Instead of a touch panel, a switch button, a mouse, a trackpad, a QWERTY keyboard, etc. can be used as the input unit 24.

[0024] <Output Unit 25> The output unit 25 displays a screen of a graphical user interface (GUI) that can be operated by the user. The output unit 25 may be included in the housing of the user terminal 20 or may be externally attached. Specifically, the output unit 25 may be implemented as a display device such as a CRT display, a liquid crystal display, an organic EL display, or a plasma display. It is preferable that these display devices are used appropriately depending on the type of user terminal 20.

[0025] 2. Functional Configuration This section describes the functional configuration of this embodiment. Information processing by software stored in the storage unit 12 is specifically realized by the control unit 11, which is an example of hardware, and can be executed as each functional unit included in the control unit 11 (a processor provided in the information processing system 1).

[0026] FIG. 4 is a block diagram showing functions realized by the server device 10 (controller 11) and the user terminal 20 (controller 21).

[0027] 4A, the server device 10 (control unit 11) includes a display control unit 111, an image acquisition unit 112, an initial prediction unit 113, a reception unit 114, a space image preparation unit 115, a selection unit 116, an impression prediction unit 117, an image presentation unit 118, a purchase method presentation unit 119, and an artificial intelligence unit 120. As shown in FIG. 4B, the user terminal 20 (control unit 21) includes a display unit 211 and an operation acquisition unit 212.

[0028] <Display control unit 111> The display control unit 111 is configured to display various information on the user terminal 20. For example, the display control unit 111 displays, on the output unit 25 of the user terminal 20, impression adjustment items selected by the selection unit 116, images created by the image presentation unit 118, etc.

[0029] <Image Acquisition Unit 112> The image acquisition unit 112 is configured to acquire an initial image of an existing space that is the target of impression adjustment. Specifically, if the existing space is a real space, the image acquisition unit 112 acquires a photograph of the real space from the user terminal 20 or another server on the network. Furthermore, if the existing space is not a real space, such as a virtual space or an image of space, the image acquisition unit 112 acquires a two-dimensional image of the space from the user terminal 20 or another server on the network. The user specifies the initial image to be acquired by the image acquisition unit 112 by selecting or uploading the initial image on the user terminal 20. Note that the data uploaded by the user may be a video. In this case, the image acquisition unit 112 extracts and acquires the initial image as a still image from the video.

[0030] It should be noted that if the target for impression adjustment is not an existing space but a new space (a space to be designed and constructed in the future), the image acquisition unit 112 does not acquire an initial image.

[0031] The types of existing spaces and new spaces are not particularly limited, and the targets for impression adjustment can include interior spaces of buildings (offices, homes, stores, public facilities, etc.), outdoor spaces (parks, gardens, etc.), interior spaces of vehicles (automobiles, aircraft, ships, etc.), etc. Furthermore, the existing spaces and new spaces may be real spaces or virtual spaces.

[0032] <Initial Prediction Unit 113> The initial prediction unit 113 is configured to predict an initial impression value of the existing space based on the initial image acquired by the image acquisition unit 112 and the first reference information. The initial impression value is the impression value of the existing space before impression adjustment is performed using impression adjustment items described below.

[0033] An "impression value" is a numerical representation of the impression (stimulus) a person feels from an object. The impression value may be a scalar or a multidimensional vector, as long as it can quantitatively express the impression felt by the user. As the impression value, two-dimensional vector data having two axes, valence and arousal, is preferable. By expressing the impression on two axes, valence and arousal, it is possible to accurately quantify the user's impression while reducing the amount of information.

[0034] The first reference information is data including a correlation between an initial image and an initial impression value. The first reference information is stored, for example, in the storage unit 12. The first reference information is an estimator constructed so as to be able to input an image and output an impression value of the image. The first reference information may include, for example, a table, a function, a simple algorithm, or the like, which indicates a correlation between a feature extracted from the initial image (e.g., vector data obtained by vectorizing an image) and the impression value. Such a correlation included in the first reference information can be constructed, for example, by statistically analyzing data recording an image and its impression value.

[0035] The first reference information may include an impression value prediction model that has been trained to be able to input an initial image and output an initial impression value. In this case, the initial prediction unit 113 inputs the initial image to the impression value prediction model of the artificial intelligence unit 120 and causes the impression value prediction model to output an initial impression value. According to this aspect, it is possible to predict impression values ​​based on impression value measurement results in a number of spaces, thereby improving the accuracy of impression value prediction.

[0036] The impression value prediction model is a learning model that has been trained so as to be able to generically input an unspecified image and output an impression value of that image. The impression value prediction model is a learning model that has been trained using a combination of learning images and impression values ​​measured for those images (quantified impressions of multiple subjects who viewed the images) as training data. In the impression value prediction model, parameters calculated, tuned, etc. by learning constitute a correlation of the first reference information.

[0037] The initial prediction unit 113 may present the impression prediction value to the user before the desired impression value is received by the later-described receiving unit 114. For example, the initial prediction unit 113 displays the impression prediction value on the user terminal 20 in the form of a numerical value (e.g., a combination of emotional valence and arousal level), a graph showing the numerical value, a keyword corresponding to the numerical value, or the like.

[0038] When the new space is a target for impression adjustment, the initial prediction unit 113 does not predict the initial impression value.

[0039] <Reception Unit 114> The reception unit 114 is configured to receive input of a desired impression value that represents a desired impression for an existing space or a new space to be newly generated from the user terminal 20. The "desired impression value" refers to the impression value of the entire existing space or the entire new space in a state in which impression adjustment items, which will be described later, have been placed. For example, if the impression value handled by the control unit 11 has two axes, valence and arousal level, the desired impression value is composed of a combination of valence and arousal level.

[0040] When accepting input of a desired impression value for an existing space, the accepting unit 114 may accept input of the desired impression value (target value) directly, or may accept input of a correction value for the current impression value (initial impression value) and accept the current impression value plus or minus the correction value as the desired impression value.

[0041] The receiving unit 114 may receive the desired impression value as a numerical input at the user terminal 20. For example, if the impression value is a combination (two-dimensional vector) of emotional valence and arousal level, the receiving unit 114 may directly receive input of these two numerical values.

[0042] Furthermore, the receiving unit 114 may receive, from the user terminal 20, a selection of a keyword expressing an emotion and receive a numerical value corresponding to the keyword as the desired impression value. According to this aspect, the user can input a desired impression value based on their sensibility. For example, the receiving unit 114 may present, to the user terminal 20, a list of keywords to which predetermined impression values ​​have been set in advance, and receive, as the desired impression value, the impression value set for the keyword selected by the user. Furthermore, the receiving unit 114 may present, to the user terminal 20, a map (graph) showing the distribution of keywords and receive an input of a selection of map coordinates. In this case, the map coordinates (the user's selected position) correspond to the keyword expressing an emotion, and the receiving unit 114 receives the selected map coordinates (e.g., a two-dimensional vector) as the desired impression value.

[0043] FIG. 5 is a diagram showing an example of a map showing the distribution of keywords displayed on the user terminal 20. In the example of FIG. 5, Russell's emotional circumplex model is used as the map. In the map of FIG. 5, the horizontal axis represents valence, and the vertical axis represents arousal. When a user selects any position on the map by performing an input operation on the user terminal 20, the numerical value on the horizontal axis of the map coordinates is converted into the valence of the desired impression value, and the numerical value on the vertical axis of the map coordinates is converted into the arousal level of the desired impression value. For example, if a user desires an impression of "energetic" for a space, coordinates near "energetic" on the map are selected. The receiving unit 114 acquires the valence and arousal level of the desired impression value based on the coordinates.

[0044] The receiving unit 114 may receive both a numerical value and a keyword that expresses an emotion as the desired impression value. That is, the receiving unit 114 may receive an input by the input means selected by the user from among the numerical value and keyword input means.

[0045] When performing impression adjustment on an existing space (i.e., when an initial impression value has been predicted by the initial prediction unit 113), the receiving unit 114 may present the predicted initial impression value and also receive input of a desired impression value. According to this aspect, the user can grasp the impression of the existing space and then set the impression value of the impression.

[0046] On the user terminal 20, the initial impression value may be displayed as a numerical value (for example, a combination of emotional valence and arousal level), may be displayed as a keyword indicating an emotion corresponding to the initial impression value, or may be displayed as a coordinate on a map showing the distribution of keywords indicating emotions (for example, the map shown in FIG. 5).

[0047] When presenting the initial impression value, the receiving unit 114 may receive input of a desired correction value (amount of correction of the impression value from the initial impression value) from the user terminal 20, or may receive input of a desired impression value (impression value after adjustment) from the user terminal 20.

[0048] On the other hand, when adjusting the impression of a new space, the receiving unit 114 may receive input of specifications of the new space along with a desired impression value of the new space. The "specifications of the new space" may include, for example, dimensions, number of occupants, incidental facilities, and purpose. Required items and non-required items may be set in advance in the specifications of the new space. Furthermore, the receiving unit 114 may present a plurality of new space templates prepared in advance to the user terminal 20 and receive the specifications of a template selected by the user as the specifications input by the user.

[0049] <Space Image Preparation Unit 115> The space image preparation unit 115 is configured to prepare an image of the new space in which impression adjustment items, which will be described later, are not arranged when impression adjustment of the new space is performed.

[0050] For example, the space image preparation unit 115 uses a space formation algorithm prepared in advance to generate an image (e.g., a two-dimensional image) of a virtual space that satisfies the specifications received by the reception unit 114. Furthermore, when the reception unit 114 receives input of a template for a new space, the space image preparation unit 115 acquires an existing space image corresponding to the template. The image of the new space prepared by the space image preparation unit 115 is used to predict the initial impression value of the new space and to present an image of the new space after the impression adjustment items have been placed.

[0051] Furthermore, the space image preparation unit 115 predicts the initial impression value of the new space based on the image of the new space and second reference information. The second reference information is data including the correlation between the image of the new space and the initial impression value. The second reference information is stored in, for example, the storage unit 12.

[0052] The second reference information may be the same as or different from the first reference information used by the initial prediction unit 113 (i.e., for predicting the initial impression value of the existing space). For example, the space image preparation unit 115 may input an image of the new space to an impression value prediction model of the artificial intelligence unit 120 and cause the impression value prediction model to output an initial impression value.

[0053] Furthermore, when the receiving unit 114 receives input of a template for a new space, the space image preparation unit 115 may acquire the (pre-calculated) impression value that is pre-included in the template as the initial impression value of the new space.

[0054] When the impression of an existing space is to be adjusted, the space image preparation unit 115 does not prepare an image.

[0055] <Selection Unit 116> The selection unit 116 is configured to select impression adjustment items that are recommended for placement in an existing space or a new space based on the desired impression value received by the reception unit 114 and the impression adjustment values ​​of each impression adjustment item included in a group of items prepared in advance. "Impression adjustment items" refer to items that can be placed in a space, and include furniture (tables, chairs, etc.), fixtures (baskets, cases, etc.), electrical equipment (lighting, monitors, speakers, etc.), plants, and decorations (paintings, ornaments, wallpaper, carpets, etc.). Note that when the target for impression adjustment is a space in a virtual space, the impression adjustment items are objects in the virtual space (for example, objects represented by a 3D model).

[0056] In the "item group," items that can be placed in a space and for which impression adjustment values ​​have been set are registered as impression adjustment items. The "impression adjustment value" is the impression value for a single impression adjustment item (or for an item that is made up of multiple items, the combination of multiple items), and is set using the same definition as the impression value of the space. Therefore, if the impression value of the space has two axes, valence and arousal, the impression adjustment value is composed of a combination of valence and arousal.

[0057] When an existing space is the target for impression adjustment, the selection unit 116 selects impression adjustment items to be recommended for placement in the existing space based on the desired impression value, the initial impression value of the existing space predicted by the initial prediction unit 113, and the impression adjustment value. According to this aspect, it is possible to present items for adjusting the existing space to the impression desired by the user.

[0058] Furthermore, when the new space is a target for impression adjustment, the selection unit 116 selects items recommended for placement in the new space based on the desired impression value, the initial impression value of the new space based on the specifications accepted by the acceptance unit 114, and the impression adjustment value. According to this aspect, an image of the new space with the impression desired by the user can be presented together with the items.

[0059] For example, the selection unit 116 may select items so that the valence and arousal of the impression adjustment value combined with the valence and arousal of the existing space or new space before the impression adjustment item is placed are close to the valence and arousal of the desired impression value. According to this aspect, it is possible to accurately suggest a space that is close to the impression desired by the user.

[0060] FIG. 6 is a diagram for explaining the adjustment of impression values. In FIG. 6 , the horizontal axis represents emotional value and the vertical axis represents arousal level, and the diagram shows an initial impression value I0 (the impression value of an existing space or a new space before the impression adjustment item is placed) and a desired impression value I1 input by the user. The selection unit 116 selects an impression adjustment item having an impression adjustment value that fills the difference between the initial impression value I0 and the desired impression value I1 (in other words, corresponds to a vector starting from the initial impression value I0 and ending at the desired impression value I1). In the example of the combination of the initial impression value I0 and the desired impression value I1 in FIG. 6 , the selection unit 116 selects an impression adjustment item that increases the arousal value by a predetermined amount and also increases the emotional value by a predetermined amount. In the example of the combination of the initial impression value I0 and the desired impression value I2 in FIG. 6 , the selection unit 116 selects an impression adjustment item that decreases the arousal value by a predetermined amount and increases the emotional value by a predetermined amount.

[0061] The selection unit 116, for example, references a table in which identification information (e.g., name, ID, etc.) of impression adjustment items is linked to the impression adjustment amounts of the impression adjustment items, and extracts impression adjustment items to be presented to the user from a group of items included in the table. The selection unit 116 may also select multiple impression adjustment items.

[0062] The impression adjustment amount of an impression adjustment item may be an impression value (a numerical representation of the impressions of multiple subjects) measured for the impression adjustment item (or an image thereof), or may be output by the impression value prediction model by inputting an image of the impression adjustment item into the impression value prediction model.

[0063] The impression-adjusting item may be a plant or a decorative item imitating a plant. According to this embodiment, the impression of an existing space or a new space can be easily and accurately adjusted. In particular, since the emotional value and arousal level of plants vary greatly depending on the type of plant, by selecting an appropriate plant species, it is possible to adjust the impression to a desired level without impairing the functionality of the space. Examples of "decorative items imitating plants" include artificial plants (fake greenery, artificial flowers, etc.), wallpaper, panels, carpets, covers, etc., printed with all or part of a plant.

[0064] <Impression Prediction Unit 117> The impression prediction unit 117 is configured to generate an item arrangement image in which the impression adjustment items selected by the selection unit 116 are arranged in an existing space or a new space, and to predict an adjusted impression value of the existing space or the new space based on the item arrangement image and the third reference information. According to this aspect, item selection can be repeated based on the impression values ​​after the items have been arranged, thereby improving the accuracy of item selection.

[0065] The "item arrangement image" is generated, for example, by superimposing an image of the selected impression adjustment item on the initial image acquired by the image acquisition unit 112 (when an existing space is the target of impression adjustment) or on the image of the new space created by the space image preparation unit 115 (when a new space is the target of impression adjustment). Also, when multiple impression adjustment items are selected by the selection unit 116, the impression prediction unit 117 generates an item arrangement image in which the multiple impression adjustment items are arranged.

[0066] Fig. 7 is a diagram showing an example of an item arrangement image AI created by the impression prediction unit 117. The item arrangement image AI in Fig. 7 is an example of an image in which an impression adjustment item CI, which is wallpaper, is arranged in an existing or initial state space SP. The item arrangement image in Fig. 7 is created by compositing the impression adjustment item CI with an image (initial image or image of a new space) before the impression adjustment item CI is arranged in the item arrangement image AI (before the wallpaper is composited).

[0067] The placement location of the impression adjustment item in the target space for impression adjustment is determined by the impression prediction unit 117, for example, according to the attributes of the impression adjustment item that have been set in advance. For example, if the attribute of the impression adjustment item is "potted plant," the impression prediction unit 117 places the impression adjustment item on the floor of the space in a position that does not interfere with other equipment. Furthermore, for example, if the attribute of the impression adjustment item is "wallpaper," the impression prediction unit 117 places the impression adjustment item so that it overlaps with the wall of the space. Furthermore, the impression prediction unit 117 may receive input from the user terminal 20 to adjust or specify the position of the impression adjustment item.

[0068] The third reference information is data including a correlation between the item arrangement image and the adjusted impression value. The third reference information is stored, for example, in the storage unit 12. The third reference information may be the same as or different from the first reference information used by the initial prediction unit 113 (i.e., for predicting the initial impression value of the existing space).

[0069] The third reference information may include an impression value prediction model that has been trained to be capable of receiving an item arrangement image as an input and outputting an adjusted impression value. In this case, the impression prediction unit 117 inputs the item arrangement image to the impression value prediction model of the artificial intelligence unit 120 and causes the impression value prediction model to output an adjusted impression value. According to this aspect, it is possible to predict impression values ​​based on measurement results of impression values ​​in a large number of spaces, thereby improving the accuracy of impression value prediction.

[0070] The impression value prediction model used by the impression prediction unit 117 may be the same as that used by the above-mentioned initial prediction unit 113 and spatial image preparation unit 115. However, the impression prediction model used by the impression prediction unit 117 (a learning model included in the third reference information and outputting adjusted impression values) and the impression prediction model used by the initial prediction unit 113 or spatial image preparation unit 115 (a learning model included in the first reference information or the second reference information and outputting initial impression values) may each be learned separately.

[0071] The impression prediction unit 117 may cause the selection unit 116 to reselect impression adjustment items when the predicted adjusted impression values ​​do not satisfy a predetermined condition. The "predetermined condition" is, for example, a condition in which the difference between the desired impression value and the adjusted impression value is equal to or less than a predetermined threshold. When the selection unit 116 reselects impression adjustment items, the impression prediction unit 117 regenerates an item arrangement image in which the reselected impression adjustment items are arranged, and re-predicts the adjusted impression values ​​of the item arrangement image. Furthermore, the impression prediction unit 117 determines whether the newly predicted adjusted impression values ​​satisfy the predetermined condition. The impression prediction unit 117 repeats the arrangement of impression adjustment items and the generation of item arrangement images until the adjusted impression values ​​satisfy the predetermined condition.

[0072] <Image Presentation Unit 118> The image presentation unit 118 is configured to present to the user the item arrangement image generated by the impression prediction unit 117. Specifically, the image presentation unit 118 causes the user terminal 20 to display the item arrangement image generated by the impression prediction unit 117 and whose adjusted impression value satisfies a predetermined condition.

[0073] The image presenting unit 118 may display the adjusted impression value together with the item arrangement image on the user terminal 20. The adjusted impression value may be displayed as a numerical value (for example, a combination of emotional valence and arousal level), or may be displayed in the form of a graph showing the numerical value, a keyword corresponding to the numerical value, or the like. In addition, the image presenting unit 118 may display information about the impression adjustment item included in the item arrangement image (for example, name, function, product number, price, etc.) on the user terminal 20.

[0074] <Purchase Method Presentation Unit 119> The purchase method presentation unit 119 presents to the user methods for purchasing the impression adjustment items included in the item arrangement image presented by the image presentation unit 118. According to this aspect, the user can confirm the image of the items arranged in space and then decide whether to purchase the items. Furthermore, since the user can purchase the items on the spot, usability is improved.

[0075] For example, the purchasing method presentation unit 119 receives, from the user terminal 20, whether or not to accept the presented item arrangement image. If the item arrangement image is accepted by the user, the purchasing method presentation unit 119 presents, to the user terminal 20, a link (URL) to a purchasing site (EC site) for the impression adjustment item included in the item arrangement image.

[0076] Furthermore, the purchase method presentation unit 119 may accept input of purchase instructions for individual impression adjustment items included in the item arrangement image from the user terminal 20. Purchase instructions for impression adjustment items are accepted, for example, by input operations on the image of the impression adjustment item itself in the item arrangement image, or on an icon (for example, a purchase button) attached to the impression adjustment item, or on a purchase button presented in an information display field for the impression adjustment item presented together with the item arrangement image.

[0077] When the purchase method presentation unit 119 receives a purchase instruction from the user terminal 20, it presents a link (URL) to a purchase site for the selected impression adjustment item to the user terminal 20. The purchase method presentation unit 119 may also cause the user terminal 20 to access the purchase site for the selected impression adjustment item and transition the display screen of the user terminal 20 to that purchase site. Furthermore, the purchase method presentation unit 119 may also directly accept a purchase of an impression adjustment item from the user terminal 20.

[0078] The user performs an operation to purchase the impression adjustment item on the presented purchase site or on the purchase screen presented by the purchase method presentation unit 119 .

[0079] <Artificial Intelligence Unit 120> The artificial intelligence unit 120 is configured to receive input from each functional unit and return the instructed output. The artificial intelligence used by the server device 10 in each functional unit may be a common one, or may be prepared individually for each functional unit.

[0080] The artificial intelligence unit 120 may include a learning model such as a language model, including a generative AI, such as a Transformer or a Recurrent Neural Network (RNN).

[0081] The language model is an example of a learning model based on a machine learning algorithm. Specific examples of machine learning algorithms include nearest neighbor methods, naive Bayes methods, decision trees, support vector machines, and deep learning using neural networks. The artificial intelligence unit 120 can apply the above algorithms as appropriate.

[0082] The artificial intelligence unit 120 may have a trained model constructed by a learning method such as supervised learning, unsupervised learning, or self-supervised learning. In supervised learning, machine learning is performed using training data (training data). The training data consists of pairs of input data for learning and output data (correct answer data). Furthermore, the language model may not only be trained for a specific task, but may also be a general-purpose model that can be used for a wide range of tasks. The learning model included in the artificial intelligence unit 120 can undergo additional training as transfer learning or fine tuning.

[0083] <Display Unit 211 > The display unit 211 of the user terminal 20 is configured to display on the output unit 25 a screen indicated by the screen data transmitted from the server device 10 .

[0084] <Operation Acquisition Unit 212 > The operation acquisition unit 212 of the user terminal 20 is configured to accept operations by the user of the user terminal 20 .

[0085] 3. Information Processing Method This section describes an information processing method of the server device 10. This information processing method is executed by a computer, with each unit of the server device 10 acting as each step.

[0086] The information processing method of the first embodiment (when adjusting the impression of an existing space) includes an image acquisition step, an initial prediction step, a reception step, a selection step, an impression prediction step, an image presentation step, and a purchase method presentation step. In the image acquisition step, an initial image of the existing space is acquired. In the initial prediction step, an initial impression value of the existing space is predicted based on the initial image and reference information. In the reception step, input of a desired impression value representing the impression desired for the existing space is accepted. In the selection step, items recommended for placement in the existing space or a new space are selected based on the desired impression value and the impression adjustment values ​​of each item included in a pre-prepared item group. In the impression prediction step, an item arrangement image in which the selected items are arranged in the existing space or the new space is generated, and an adjusted impression value of the existing space or the new space is predicted based on the item arrangement image and the reference information. In the image presentation step, the item arrangement image is presented to the user. In the purchase method presentation step, a method for purchasing items included in the item arrangement image is presented to the user.

[0087] 8 is an activity diagram showing a first pattern of the flow of information processing (processing for adjusting the impression of an existing space) according to the first embodiment, which is executed by the information processing system 1. The information processing will be described below along with each activity in this activity diagram.

[0088] The first pattern of impression adjustment processing for an existing space begins with acquiring an image of the target existing space. The user, for example, specifies an image of the existing space by taking a photo using the user terminal 20 and uploading it (activity A110). The server device 10 acquires the specified image from the user terminal 20 as an initial image (activity A120). Next, the server device 10 predicts an initial impression value for the initial image and outputs it to the user terminal 20 (activity A130). This causes the initial impression value to be displayed on the user terminal 20 (activity A140).

[0089] The user refers to the initial impression value and inputs a desired impression value into the user terminal 20 (activity A150). The server device 10 accepts the input desired impression value from the user terminal 20 (activity A160). Next, the server device 10 selects impression adjustment items using the desired impression value (activity A170). Next, the server device 10 generates an item arrangement image in which the selected impression adjustment items are arranged on the initial image (activity A180). Furthermore, the server device 10 predicts the adjusted impression value of the item arrangement image (activity A190).

[0090] The server device 10 determines whether the predicted adjusted impression value satisfies a predetermined condition (target value) (activity A200). If the adjusted impression value does not satisfy the condition, the server device 10 repeats the process from activity A170 (selection of impression adjustment items). If the adjusted impression value satisfies the condition, the server device 10 outputs an item arrangement image to the user terminal 20 (activity A210). As a result, the item arrangement image is displayed on the user terminal 20 (activity A220).

[0091] The user inputs into the user terminal 20 whether or not to accept the item arrangement image displayed on the user terminal 20 (activity A230). If the user does not accept (rejects) the presented item arrangement image, the user re-inputs the desired impression value in activity A150. In this case, the display screen of the user terminal 20 transitions from the display screen of the item arrangement image to a screen for inputting the desired impression value. If the user accepts the presented item arrangement image (if the server device 10 receives input of acceptance from the user terminal 20), the server device 10 presents a method for purchasing the adjusted impression item (activity A240). The user refers to the presented purchase method and purchases the adjusted impression item on the user terminal 20 (activity A250).

[0092] Fig. 9 is an activity diagram showing a second pattern of the flow of information processing (processing for adjusting the impression of an existing space) according to the first embodiment, which is executed by the information processing system 1. The activity diagram of the second pattern in Fig. 9 is obtained by adding an image confirmation activity A260 on the user terminal 20 to the activity diagram of the first pattern in Fig. 8 (for this reason, some activities common to Fig. 8 are omitted in Fig. 9).

[0093] In activity A260, the user checks the initial impression value displayed on the user terminal 20 and determines whether or not to change the image of the existing space. If the image is to be changed, the user performs an input operation to change the image on the user terminal 20 and re-specifies the image for activity A110. In this case, the display screen of the user terminal 20 transitions from the initial impression value display screen to an image specification screen. If the image is not to be changed, the user inputs a desired impression value for activity A150 on the user terminal 20.

[0094] The information processing method of the second embodiment (when performing impression adjustment of a new space) includes a receiving step, a selection step, an impression prediction step, an image presentation step, and a purchase method presentation step. In the receiving step, input of the specifications of the new space along with a desired impression value of the new space is accepted. In the selection step, items recommended for placement in the existing space or the new space are selected based on the desired impression value and the impression adjustment values ​​of each item included in a pre-prepared item group. In the impression prediction step, an item arrangement image in which the selected items are arranged in the existing space or the new space is generated, and an adjusted impression value of the existing space or the new space is predicted based on the item arrangement image and reference information. In the image presentation step, the item arrangement image is presented to the user. In the purchase method presentation step, a method for purchasing the items included in the item arrangement image is presented to the user.

[0095] 10 is an activity diagram showing the flow of information processing (design processing of a new space) according to the second embodiment, which is executed by the information processing system 1. The information processing will be described below along with each activity in this activity diagram.

[0096] The design process for a new space begins with receiving specifications and desired impression values ​​for the new space. The user inputs the specifications and desired impression values ​​for the new space into the user terminal 20 (activity A310). The server device 10 receives the input specifications and desired impression values ​​from the user terminal 20 (activity A320). Next, the server device 10 prepares an image of the new space based on the specifications (activity A330). Furthermore, the server device 10 predicts the initial impression value of the image (activity A340).

[0097] The server device 10 executes activities similar to activities A170-A250 in the activity diagram of FIG. 8 using the initial impression value of the initial space predicted from the image.

[0098] 4. Functions The functions of this embodiment can be summarized as follows: That is, the user can select items to configure a space with a desired impression. As a result, the impression of the space can be adjusted by the selected items.

[0099] Although the embodiment of the present invention has been described above, the present invention is not limited to this and can be modified as appropriate within the scope of the technical idea of ​​the invention.

[0100] 5. Others In the above embodiment, the server device 10 performs various storage and control functions. However, multiple external devices may be used instead of the server device 10. That is, various pieces of information and programs may be distributed and stored in multiple external devices using blockchain technology or the like. In particular, the artificial intelligence unit 120 may be an external component of the server device 10.

[0101] The aspect of the present embodiment is not limited to the information processing system 1, and may be an information processing method or a program. The information processing method includes steps executed by the information processing system 1. The program causes a computer to execute the steps of the information processing system 1.

[0102] At least one of the devices included in the information processing system 1 may be installed outside the country in which the functions of the information processing system 1 are performed.

[0103] The information processing system 1 may be an integrated system of the server device 10 and the user terminal 20. For example, the user terminal 20 may perform processes such as prediction of impression values ​​and selection of impression adjustment items. In other words, the user terminal 20 may be an information processing device that performs impression adjustment of a space.

[0104] It may be provided in the following manner.

[0105] (1) An information processing system comprising a processor configured to execute each of the following steps by reading a program: a reception step of receiving an input of a desired impression value that represents the impression desired for an existing space or a new space to be newly generated; and a selection step of selecting the items recommended for placement in the existing space or the new space based on the desired impression value and impression adjustment values ​​of each item included in a group of items prepared in advance.

[0106] According to this aspect, the user can select items to configure a space with a desired impression, and as a result, the impression of the space can be adjusted by the selected items.

[0107] (2) In the information processing system described in (1) above, the desired impression value and the impression adjustment value are each composed of a combination of valence and arousal, and in the selection step, the item is selected so that the valence and arousal of the existing space or the new space before the item is placed combined with the valence and arousal of the impression adjustment value approaches the valence and arousal of the desired impression value, respectively.

[0108] According to this aspect, it is possible to accurately propose a space that is close to the impression desired by the user.

[0109] (3) In the information processing system described in (1) or (2) above, the item is a plant or an ornament that resembles a plant.

[0110] According to this aspect, the impression of an existing space or a new space can be easily and accurately adjusted.

[0111] (4) In the information processing system according to any one of (1) to (3) above, in the receiving step, a selection of a keyword expressing an emotion is received, and a numerical value corresponding to the keyword is received as the desired impression value.

[0112] According to this aspect, the user can input a desired impression value based on his or her sensibility.

[0113] (5) In the information processing system described in any one of (1) to (4) above, the processor is configured to further execute the following steps: in the impression prediction step, an item arrangement image in which the selected items are arranged in the existing space or the new space is generated, and an adjusted impression value of the existing space or the new space is predicted based on the item arrangement image and reference information, wherein the reference information includes a correlation between the item arrangement image and the adjusted impression value.

[0114] According to this aspect, the selection of items can be repeated based on the impression values ​​after the items are placed, thereby improving the accuracy of the selection of items.

[0115] (6) In the information processing system described in (5) above, the reference information includes an impression value prediction model that has been trained to be able to input the item arrangement image and output the adjusted impression value, and in the impression prediction step, the item arrangement image is input to the impression value prediction model, and the impression value prediction model is caused to output the adjusted impression value.

[0116] According to this aspect, it is possible to predict impression values ​​based on the results of measuring impression values ​​in a large number of spaces, thereby improving the accuracy of the prediction of impression values.

[0117] (7) In the information processing system described in (5) or (6) above, the processor is configured to further perform the following steps: in the image presentation step, presenting the item placement image to the user; and in the purchase method presentation step, presenting to the user a method for purchasing the item included in the item placement image.

[0118] According to this aspect, the user can check the image of the items arranged in the space before deciding whether to purchase the items. Furthermore, since the user can purchase the items on the spot, usability is improved.

[0119] (8) In the information processing system described in any one of (1) to (7) above, the processor is configured to further execute the following steps: in the image acquisition step, an initial image of the existing space is acquired; in the initial prediction step, an initial impression value of the existing space is predicted based on the initial image and reference information, wherein the reference information includes a correlation between the initial image and the initial impression value; and in the reception step, the predicted initial impression value is presented and an input of the desired impression value is received.

[0120] According to this aspect, the user can set a desired impression value after grasping the impression of the existing space.

[0121] (9) In the information processing system described in any one of (1) to (7) above, in the reception step, input of specifications for the new space along with the desired impression value of the new space is received, and in the selection step, the items recommended for placement in the new space are selected based on the desired impression value, the initial impression value of the new space, and the impression adjustment value.

[0122] According to this aspect, an image of a new space that gives the impression desired by the user can be presented together with the items.

[0123] (10) An information processing method comprising steps executed by the information processing system according to any one of (1) to (9) above.

[0124] (11) A program for causing a computer to execute each step of the information processing system described in any one of (1) to (9) above. Of course, this is not a limitation.

[0125] 1: Information processing system, 2: Communication line, 10: Server device, 11: Control unit, 12: Memory unit, 13: Communication unit, 14: Communication bus, 20: User terminal, 21: Control unit, 22: Memory unit, 23: Communication unit, 24: Input unit, 25: Output unit, 26: Communication bus, 111: Display control unit, 112: Image acquisition unit, 113: Initial prediction unit, 114: Reception unit, 115: Space image preparation unit, 116: Selection unit, 117: Impression prediction unit, 118: Image presentation unit, 119: Purchase method presentation unit, 120: Artificial intelligence unit, 211: Display unit, 212: Operation acquisition unit, AI: Item placement image, CI: Impression adjustment item, SP: Space

Claims

1. An information processing system comprising a processor, the processor being configured to execute the following steps by reading a program: a reception step receiving input of a desired impression value that represents the impression desired for an existing space or a new space to be newly generated; and a selection step selecting items recommended for placement in the existing space or the new space based on the desired impression value and impression adjustment values ​​of each item included in a group of items prepared in advance.

2. An information processing system according to claim 1, wherein the desired impression value and the impression adjustment value are each composed of a combination of valence and arousal, and in the selection step, the item is selected so that the valence and arousal of the existing space or the new space before the item is placed combined with the valence and arousal of the impression adjustment value are close to the valence and arousal of the desired impression value.

3. An information processing system according to claim 1 or 2, wherein the item is a plant or a decorative item that resembles a plant.

4. An information processing system according to any one of claims 1 to 3, wherein the receiving step receives a selection of a keyword expressing an emotion, and receives a numerical value corresponding to the keyword as the desired impression value.

5. An information processing system according to any one of claims 1 to 4, wherein the processor is further configured to perform the following steps: in the impression prediction step, an item arrangement image is generated in which the selected items are arranged in the existing space or the new space, and an adjusted impression value of the existing space or the new space is predicted based on the item arrangement image and reference information, wherein the reference information includes a correlation between the item arrangement image and the adjusted impression value.

6. An information processing system according to claim 5, wherein the reference information includes an impression value prediction model that has been trained to be able to input the item arrangement image and output the adjusted impression value, and wherein in the impression prediction step, the item arrangement image is input to the impression value prediction model, and the impression value prediction model is caused to output the adjusted impression value.

7. An information processing system according to claim 5 or claim 6, wherein the processor is configured to further perform the following steps: in an image presentation step, presenting the item arrangement image to the user; and in a purchase method presentation step, presenting to the user a method for purchasing the item included in the item arrangement image.

8. An information processing system according to any one of claims 1 to 7, wherein the processor is configured to further execute the following steps: in the image acquisition step, an initial image of the existing space is acquired; in the initial prediction step, an initial impression value of the existing space is predicted based on the initial image and reference information, wherein the reference information includes a correlation between the initial image and the initial impression value; and in the reception step, the predicted initial impression value is presented and an input of the desired impression value is received.

9. An information processing system according to any one of claims 1 to 7, wherein the reception step receives input of specifications for the new space along with the desired impression value of the new space, and the selection step selects the items recommended for placement in the new space based on the desired impression value, the initial impression value of the new space, and the impression adjustment value.

10. An information processing method comprising the steps executed by the information processing system according to any one of claims 1 to 9.

11. A program for causing a computer to execute each step of the information processing system according to any one of claims 1 to 9.

Images