Information processing apparatus, program, and system

Abstract

To provide a technique that enables a user to learn an appropriate operation method of a cosmetic device in a simpler manner. One aspect of the invention provides an information processing device. The image processing device is provided with an analysis section, an operation mode decision section, and a transmission section. The analysis section is configured to analyze an image captured by a capturing section. The image includes an aspect in which a user brings the cosmetic device into contact with the user's skin. The operation mode decision section is configured to decide an operation mode of the cosmetic device based on the aspect. The transmission section is configured to transmit a switching signal for switching to the decided operation mode to the cosmetic device.

Description

TECHNICAL FIELD

[0001] The present application relates to an information processing apparatus, a program, and a system. BACKGROUND

[0002] In recent years, cosmetic devices for nursing the skin of a user are becoming popular. Patent Literature 1 discloses a beauty device as an example of a cosmetic device, which can bring a predetermined cosmetic effect to the skin of a user.

[0003] PRIOR ART DOCUMENT

[0004] PATENT LITERATURE

[0005] Patent Literature 1: Japanese Patent Application Laid-Open No. 2005-237545 SUMMARY

[0006] PROBLEMS TO BE SOLVED BY THE INVENTION

[0007] Such a cosmetic device can have a plurality of operation modes, such as a cleaning mode, a moisturizing mode, and the like. In addition, since the effects pursued differ depending on the different parts of the skin, different modes can be switched to be used in accordance with the different parts of the skin.

[0008] However, the switching of the various modes needs to be performed manually by the user himself or herself, and in order to maximize the effects of the cosmetic device, the user must learn the appropriate operation method.

[0009] In view of the above, the present application aims to provide a technique that enables a user to more easily master the appropriate operation method of a cosmetic device.

[0010] SOLUTION TO THE PROBLEM

[0011] According to one aspect of the present application, there is provided an information processing apparatus. The information processing apparatus includes an analysis section, an operation mode decision section, and a transmission section. The analysis section is configured to analyze an image in a photographing by a photographing section. The image is an image including a form in which a user contacts a cosmetic device with his or her own skin. The operation mode decision section is configured to decide an operation mode of the cosmetic device in accordance with the form. The transmission section is configured to transmit a switching signal to switch to the decided operation mode to the cosmetic device.

[0012] By using such an information processing apparatus to use a cosmetic device, the optimal nursing in accordance with the parts of the skin can be achieved without manually switching the operation mode. BRIEF DESCRIPTION OF DRAWINGS

[0013] Figure 1 is a structural overview diagram showing the system 1 of the present embodiment.

[0014] Figure 2 is a block diagram showing the hardware structure of the information processing apparatus 2.

[0015] Figure 3 This is an example of a GUI displayed on the display unit of the information processing device 2.

[0016] Figure 4 This is a block diagram representing the hardware structure of the beauty device 3.

[0017] Figure 5 This is a diagram showing the appearance of beauty device 3.

[0018] Figure 6 This is a functional block diagram representing the functions of the information processing device 2.

[0019] Figure 7 This is an example of a screen displaying overlapping images.

[0020] Figure 8 This is an example of a screen displaying an overlaid image in magnified form.

[0021] Figure 9 This is an example of a screen displaying suggested ADs to a user using the beauty device 3.

[0022] Figure 10 This is a functional block diagram representing the functions of the beauty device 3.

[0023] Figure 11 This is an activity diagram illustrating the usage method flow of System 1 in this embodiment. Detailed Implementation

[0024] The embodiments of the present invention will now be described with reference to the accompanying drawings. Various features in the embodiments shown below can be combined with each other.

[0025] The program used to implement the software in this embodiment can be provided as a non-transitory computer-readable medium, or it can be downloaded from an external server, or the program can be launched by an external computer to implement the function on a client terminal (i.e., so-called cloud computing).

[0026] In this embodiment, "part" can be a concept that includes, for example, hardware resources implemented in a generalized circuit and software information processing specifically implemented by these hardware resources. Furthermore, this embodiment involves various types of information, which can be represented, for example, by physical values ​​representing signal values ​​of voltage or current, or as high or low signal values ​​of a binary bit set consisting of 0s or 1s, or by quantum superposition (i.e., so-called qubits), and can perform communication and computation on a generalized circuit.

[0027] Furthermore, in a broader sense, a circuit is a circuit implemented by at least appropriately combining circuits, circuitry, processors, and memory. That is, it includes application-specific integrated circuits (ASICs), programmable logic devices (such as simple programmable logic devices (SPLDs) and complex programmable logic devices (CPLDs), and field-programmable gate arrays (FPGAs), etc.

[0028] 1.1 Hardware Structure

[0029] In this section, the hardware structure of this embodiment will be described. Figure 1 This is a structural schematic diagram of system 1 in this embodiment.

[0030] 1.1 System 1

[0031] System 1 includes an information processing device 2, a beauty device 3, and a server 4, configured to communicate via telecommunication lines. In other words, the information processing device 2 is configured to communicate with the beauty device 3 and the server 4 via a network.

[0032] 1.2 Information Processing Device 2

[0033] Figure 2 This is a block diagram showing the hardware structure of the information processing device 2. The information processing device 2 includes a communication unit 21, a storage unit 22, a control unit 23, a display unit 24, an input unit 25, and a camera unit 26. These components are electrically connected within the information processing device 2 via a communication bus 20. Each component will be further explained below.

[0034] (Communications Department 21)

[0035] While the communication unit 21 preferably uses wired communication methods such as USB, IEEE 1394, Thunderbolt, and wired LAN network communication, it may also include wireless LAN network communication, mobile communication such as LTE / 3G, and Bluetooth communication as needed. In other words, it is more preferable to implement it as a combination of these multiple communication methods.

[0036] (Storage Department 22)

[0037] Storage unit 22 stores the various information defined in the above description. It can be implemented, for example, as a storage device such as a solid-state drive (SSD) storing various programs related to the information processing device 2 executed by control unit 23, or as a memory such as random access memory (RAM) storing temporary necessary information (parameters, arrangements, etc.) related to program operation. Alternatively, a combination of these may also be used.

[0038] (Control Department 23)

[0039] The control unit 23 performs processing and control of the overall operation related to the information processing device 2. The control unit 23 is, for example, a central processing unit (CPU) not shown. The control unit 23 implements various functions related to the information processing device 2 by reading predetermined programs stored in the memory unit 22. In other words, by implementing software (stored in the memory 22) information processing concretely by hardware (control unit 23), various functional units (see...) can be included in the control unit 23. Figure 6 This will be executed. These will be explained in more detail in Section 2.

[0040] The control unit 23 is not limited to a single unit; it can also be implemented as multiple control units 23 according to different functions. Alternatively, it can be a combination of these.

[0041] (Display Unit 24)

[0042] The display unit 24 may be contained within the housing of the information processing device 2, or it may be externally attached. The display unit 24 displays a graphical user interface (GUI) screen that can be operated by the user U. For example, it is preferable to use display devices such as CRT monitors, liquid crystal displays, organic EL displays, and plasma displays, respectively, corresponding to the type of information processing device 2.

[0043] In this embodiment, the display unit 24 is configured to display the image 51 captured by the imaging unit 26. Specifically, the display unit 24 is configured to display the treatment situation using the beauty device 3 captured by the imaging unit 26. Based on this configuration, the information processing device 2 is configured to display the captured images while capturing the treatment situation of the user U. Figure 3 This illustrates an example of a GUI displayed on the display unit of the information processing device 2. As shown in the figure, the display unit 24 displays the user U and the beauty device 3, and displays an image of the beauty device 3 in contact with the user U's face.

[0044] In the information processing device 2, the display unit 24 can be formed on a mirror surface. With this configuration, the information processing device 2 functions as a mirror when it is not activated. When the information processing device 2 is activated, the user U reflected in the mirror is displayed overlapping various icons or text. Such a mirror surface can be a two-way mirror or a three-way mirror, and multiple imaging units 26 can be provided on each mirror surface. Therefore, the information processing device 2 can capture images of the user U from multiple angles.

[0045] (Input Section 25)

[0046] The input unit 25 can be contained within the housing of the information processing unit 2 or attached externally. Particularly in this embodiment, the input unit 25 is preferably integrated with the display unit 24 and implemented as a touch panel. If it is a touch panel, the user U can input data through touch operations, swipe operations, etc. Of course, a switch button, mouse, QWERTY keyboard, etc., can also be used instead of a touch panel.

[0047] In other words, the display unit 24 and the input unit 25 are touch panels, and the control unit 23 (operation mode determination unit 232 described later) is configured to determine the operation mode desired by the user U based on the user U's input command to the touch panel. Specifically, when the user U wishes to manually switch operation modes, they can switch operation modes by operating the touch panel. For example, when the user U clicks the operation mode icon IC1 or the operation setting icon IC2... Figure 3 When this happens, a list of switchable operating modes will be displayed, and user U can then select any mode from this list to switch to the desired operating mode. It should be noted that... Figure 3 This is merely an example and does not limit the operations performed when executing input commands or the display format of the operation settings icon IC2.

[0048] (Filming Department 26)

[0049] The camera unit 26 is, for example, a CCD camera or a CMOS camera, and is configured to capture images of the user U using the beauty device 3 described later. For example, the camera unit 26 is preferably configured to be built into the information processing device 2, for example, located at the upper part of the display unit 25. Of course, this example is not limited to this, and the camera unit 26 can also be externally attached via a camera connected via USB.

[0050] Furthermore, the imaging unit 26 preferably captures images of the user U before and after the treatment performed by the beauty device 3, and these images are preferably stored in the storage unit 22. With this configuration, images before and after using the beauty device 3 are stored. Thus, the user U can check their face before and after using the beauty device 3. In other words, the user U can confirm the treatment effect of the beauty device 3 by viewing before-and-after comparison photos.

[0051] 1.3 Beauty Device 3

[0052] Figure 4 This is a block diagram showing the hardware structure of the beauty device 3. The beauty device 3 includes a communication unit 31, a storage unit 32, and a control unit 33, which are electrically connected within the beauty device 3 via a communication bus 30. For detailed descriptions of the communication unit 31, storage unit 32, and control unit 33, please refer to the diagrams for communication unit 21, storage unit 22, and control unit 23. Furthermore, Figure 5 This diagram shows the appearance of the beauty device 3. The beauty device 3 includes an operation section 3a and a gripping section 3b. The components will be further explained below.

[0053] (Operation Section 3a)

[0054] The beauty device 3 is configured to include an operating part 3a and a gripping part 3b serving as its support. The operating part 3a is configured to be operated in contact with the skin of the user U and is located at the end of one side of the gripping part 3b in the longitudinal direction. The skin in contact with the operating part 3a includes, for example, the skin of the upper body. Here, the upper body includes at least one of the following: the area around the face, the area around the neck, and the area around the chest. In other words, it refers to the skin above the shoulder blades in the upper body. For example, it refers to the face, chin, neck, collarbone area, chest, head, etc. It should be noted that this is not limited to the above-mentioned areas and may also include the back of the neck, abdomen, back, waist, arms, and even the lower body such as the buttocks and feet. This will be explained in detail later.

[0055] (Grip part 3b)

[0056] The gripping part 3b is a rod-shaped part that is gripped by the user U. The gripping part 3b may be equipped with operation buttons, which can be operated by the user U when starting or ending the operation of the beauty device 3 or when changing the operation mode.

[0057] 2. Functional Structure

[0058] Section 2 will describe the functional structure of this embodiment.

[0059] 2.1 Functional Structure of Information Processing Device 2

[0060] Figure 6 This is a block diagram illustrating the functions of the information processing device 2. As described above, the information processing of software (stored in the storage unit 22) is specifically implemented through hardware (control unit 23), and can be executed as various functional units included in the control unit 23.

[0061] Specifically, the information processing device 2 includes an analysis unit 231, an operation mode determination unit 232, a transmission unit 233, a display control unit 234, and a proposal unit 235.

[0062] (Analysis Department 231)

[0063] Analysis unit 231 is configured to analyze image 51 captured by imaging unit 26. Figure 3 Here, image 51 is an image showing the user U bringing the beauty device 3 into contact with their own skin. Specifically, for example, when the user U uses the beauty device 3 for skin care, the imaging unit 26 captures the user U using the beauty device 3. The captured image 51 is temporarily stored in the storage unit 22 (cache), while the analysis unit 231 analyzes the position of the beauty device 3 (especially the operation unit 3a) contained in the image 51. The use of the beauty device 3 refers to, for example, when the user U is performing skin care treatments, bringing the operation unit 3a into contact with their skin.

[0064] In particular, the analysis unit 231 is configured to analyze the part information of the beauty device 3 based on the image 51. Here, part information refers to information representing the parts of the upper body included in the captured image 51. It is particularly preferred that the number of upper body parts is configured to be more than 3 and less than 20, and that each part is identified separately for the left and right sides. Specifically, the number of parts is, for example, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, and may also be within any two of the values ​​listed herein. Not only the above-mentioned parts, but also the abdomen, arms, chest, buttocks, thighs, around the knees, calves, etc., can be identified separately. In addition, if it is a part of the face, it includes, for example, the forehead, eyes, nose, mouth, the C-zone connecting the outer corner of the eye to the lower eyelid, cheeks, facial lines, throat, neck, etc. In addition, location information can include not only the location itself, but also information related to the condition of the location, such as skin brightness, sharpness, roughness, acne, redness, and dullness.

[0065] (Operation Mode Determination Section 232)

[0066] The operation mode determination unit 232 is configured to determine the operation mode of the beauty device 3 based on the form of image 51. With this configuration, the operation mode can be switched for each skin area or skin condition that the beauty device 3 contacts. There are no particular limitations on the operation mode, but in terms of the functions performed by the operation unit 3a, modes such as switching current frequency or changing temperature are preferred. Examples include a cleansing mode to remove dirt and sebum from pores, an iontophoresis mode, a moisturizing mode to allow skincare water to penetrate the skin, a fine-tuning mode to adjust the current output to the skin, an EMS mode to stimulate facial muscles, a lifting mode for tightening facial contours, and an eye area mode for dark circles or fine lines. In this way, when the user U applies the beauty device 3 to their skin for treatment, the user U can perform appropriate and meticulous care for each area without switching operation modes.

[0067] (Department 233)

[0068] When the operating mode is determined by the operating mode determination unit 232, the transmission unit 233 is configured to send a switching signal to the beauty device 3 to switch to the determined operating mode. Upon receiving the switching signal, the beauty device 3 operates in the prescribed operating mode. The functions of the beauty device 3 will be described in detail later.

[0069] The sending unit 233 is configured to send images of the user U before and after using the beauty device 3 to an external server 4. With this configuration, the external server 4 can accumulate beauty data related to the user U's use of the beauty device 3, and the user U can access the server 4 to check the changes in their face in chronological order. The images of the user U before and after using the beauty device 3 can be configured to be stored in the storage unit 22 of the beauty device 3, allowing the user U to check the changes in their face in chronological order, similar to when accessing the server 4. The sending unit 233 is not limited to sending images before and after using the beauty device 3; it can also be configured to send data related to the specifications of the beauty device 3, such as usage history, to the server 4.

[0070] Furthermore, the server 4 can be configured to send beauty information to the information processing device 2 based on stored images before and after the use of the beauty device 3, or data related to the use of the beauty device 3, and the information processing device 2 can display the beauty information received from the server 4 on the display unit 24. This allows for the provision of appropriate beauty information or suggestions to the user U. Moreover, such images can be integrated into an external server 4 and used as teacher data to perform machine learning, thereby further improving the control performance for switching operating modes.

[0071] (Display Control Unit 234)

[0072] The display control unit 234 generates various screens for display on the display unit 24 and controls their display. The following will describe in detail various screen display examples of the display control unit 234, focusing on the display unit 24.

[0073] For example, the display unit 24 overlays the image 51 of the user U captured by the camera unit 26, as well as various icons or text. Here, various icons or text refer to icons or text that represent, for example, the operation mode icon IC1, the operation setting icon IC2, the calibration line, the suggestion AD, the date, the time, and the remaining battery level.

[0074] Display unit 24 displays the name of the operating mode currently in operation of beauty device 3. Figure 3 The operation mode icon IC1 shown is an example of the currently running operation mode. As illustrated, the currently running operation mode corresponds to the automatic mode for the cheek, and includes RF mode, EMS mode, and PHOTO mode. Based on this configuration, user U can immediately confirm the currently running operation mode.

[0075] Furthermore, the preferred beauty device 3 is a beauty container, the skin includes facial skin, and the display unit 24 is configured to display an overlay image 5. Here, the overlay image 5 is an image that is overlaid on an image 51 containing the user U's face during a photograph, and an ideal image containing the user U's ideal face. Moreover, the user U's ideal face is preferably a face generated based on at least a portion of the user U's face to achieve symmetry. With this configuration, since a bilaterally symmetrical face, which is one of the standards of beauty, is displayed, the user U's ideal face as a target becomes clear, which helps in implementing treatment.

[0076] Figure 7 This is an example of an overlaid image displayed by the information processing device 2. Figure 7 In the example, the captured image 51 and the overlapping image 5 are vertically divided into two parts for display. Specifically, the left half of the split display shows the left half of the user U's face in the captured image, displaying various parts of the left half of the user U's face, such as the left facial lines 52, the left eyebrow 53, and the left eye 54.

[0077] On the other hand, the right half of the screen displays the right side of User U's face. Specifically, it shows various parts of User U's right side face, such as the right eyebrow 55, right eye 56, and right facial lines 57. Additionally, it displays an image that reverses the left side of User U's face, specifically, the left facial lines 52, left eyebrow 53, and left eye 54, etc., showing the images reversed horizontally. In other words, at least... Figure 7The overlapping image 5 in the text refers to the image that overlaps the image of the right half of user U's face and the image that flips the left half of user U's face horizontally. In this case, the ideal face of user U refers to the image that flips the left half of user U's face horizontally.

[0078] Overlapping images are not limited to Figure 7 The example shown can also overlay an image of the right half of user U's face, flipped horizontally, with an image of the left half of user U's face, or it can overlay only a portion of user U's face. For example, an image of the right half of user U's face can be overlaid with an image of the left side of user U's face, flipped horizontally (line 52). Furthermore, the overlaid images are not limited to the currently captured image; the currently captured image of user U's face can also be overlaid with previously captured images of user U's face.

[0079] User U's ideal face is not necessarily their own; it could be another user U's face or the face of a specific person that user U desires. The information processing device 2 can determine the ideal face. For example, it could be a celebrity such as an idol or model. Moreover, it is preferable that user U can freely choose the ideal face and can overlay the ideal face onto their own face for display.

[0080] Display unit 24 can also further overlap and display correction lines on the overlapping image 5 along the boundary of the ideal facial region of user U. Specifically, for example, when the image of user U's left facial line 52, displayed in a left-right reversal, overlaps with the image of user U's right facial line 57, display unit 24 overlaps and displays auxiliary lines at the boundary of the left facial line 52, which is the ideal facial region. Figure 7 When operating the beauty device 3, the user U can clearly grasp the difference between their ideal face and the corrected face through this correction guide.

[0081] Correction lines are preferably displayed in a conspicuous manner. For example, they can be made more prominent by setting their color to an easily noticeable color or by thickening the guide lines, but the display of correction lines is not limited to these methods. Correction lines do not necessarily have to be solid lines; they can also be dashed lines. Furthermore, correction lines do not necessarily have to be straight lines or curves; they can also be displayed as surfaces encompassing specific areas.

[0082] Additionally, an emphasis icon IC3 can be displayed around the correction line. Figure 7 With this configuration, the visibility of the calibration lines can be improved, and the user U can immediately determine the location of the calibration lines.

[0083] The display 24 can also magnify at least a portion of its displayed content. Figure 8 It is Figure 7The example shown is an overlaid image magnified display. As shown in the example, only the area around user U's face is magnified. This allows user U to focus on areas requiring more detailed treatment. The magnified image display is not limited to this. Figure 8 The example shown is an example of a display format where the image showing user U's face is horizontally divided into two parts, with only the upper half being magnified and the lower half not. Alternatively, a specific area specified by user U can be magnified. For example, a frame containing a magnified image can be placed in the corner of the image, and the facial portion specified by user U can be magnified and displayed within that frame.

[0084] (Proposal Department 235)

[0085] The suggestion unit 235 is configured to provide suggestions (ADs) regarding the use of the beauty device 3 to the user U based on the captured image 51. Furthermore, the suggestion AD is preferably associated with at least one of the operating trajectory, speed, and usage time of the beauty device 3. The suggestion AD is displayed on the display unit 24 by the display control unit 234.

[0086] Specifically, such as Figure 9 As shown. Figure 9 This is an example of a screen displaying suggested instructions to user U using beauty device 3. As shown in the example, a comment such as "Move your head at this speed" is displayed in the upper left corner of the screen, but the display format is not limited to this. For example, it could also display suggestions such as "Please move your head a little faster," "Please move your head slightly to the left," "Please hold this position for another 30 seconds," "Please move your head in a circle," or "That's it. Please proceed with the treatment of other areas." In this way, user U can not only confirm the function or operation method of beauty device 3 during its use, but also improve the operability of beauty device 3 and reduce the effect deviation caused by individual differences in usage methods through the suggested methods, thereby maximizing the effect of beauty device 3.

[0087] When making suggestions to user U regarding the use of beauty device 3, AD is provided, it is preferable to display the operation assistance icon IC4. Figure 9 More preferably, the operation assistance icon IC4 is accompanied by animation. Specifically, it is preferable that the operation assistance icon IC4 is accompanied by animation display. For example, when the user U touches the beauty device 3 to the cheek, it is preferable that the operation assistance icon IC4 moves at the same speed as when using the beauty device 3 on the cheek. Thus, the user U can easily judge what speed is better to move the beauty device 3, thereby being able to use the beauty device 3 in a more efficient way.

[0088] Furthermore, the suggested AD and beauty device 3 displayed on the preferred display unit 24 do not overlap with the area of ​​the user U's skin that comes into contact with them. For example, as Figure 9 As shown, when user U brings beauty device 3 into contact with their cheek, it is preferable that the suggestion AD is displayed in a position that avoids the cheek area. With this configuration, it is possible to prevent user U from visually recognizing their own skin and beauty device 3 due to the display of the suggestion AD while using the beauty device 3.

[0089] The method of proposing ADs is not limited to displaying comments on display unit 24; suggestions for ADs can also be made to user U via sound. Note that comments on suggested ADs can also be displayed on displays such as... Figure 7 or Figure 8 The image shown is an overlay image.

[0090] 2.2 Functional Structure of Beauty Device 3

[0091] Figure 10 This is a functional block diagram representing the functions of the beauty device 3. As described above, the information processing of the software (stored in the storage unit 32) is implemented by the hardware (control unit 33), and can be executed as various functional units included in the control unit 33.

[0092] Specifically, the beauty device 3 includes a receiving unit 332 and an operation control unit 331.

[0093] When the transmitting unit 233 of the information processing device 2 sends a switching signal to the beauty device 3 to switch to the determined operating mode, the receiving unit 332 of the beauty device 3 is configured to receive the switching signal from the information processing device 2.

[0094] The operation control unit 331 is configured to control the operation unit 3a to operate in a predetermined operation mode according to a switching signal. Specifically, the operation control unit 331 is configured to control the operation unit 3a to operate in a predetermined operation mode according to a switching signal received by the receiving unit 332. Note that it can also be configured to operate multiple operation modes simultaneously. In this way, when the user U uses the beauty device 3 for treatment, the beauty device 3 can implement a determined operation mode according to the skin area of ​​the user U that the beauty device 3 contacts. This allows the beauty device 3 to operate appropriate operation modes for different areas.

[0095] 3. How to use System 1

[0096] Section 3 will provide an example of how to use System 1. Figure 11 This is an activity diagram illustrating the usage method flow of System 1 in this embodiment. The following will follow... Figure 11 The various activities within the program will be explained.

[0097] [start]

[0098] (Activity A1)

[0099] User U performs an operation that brings the operation unit 3a of the beauty device 3 into contact with user U's skin. At this time, the transmission unit 333 of the beauty device 3 can send the specific operation detected by the sensors of the beauty device 3 to the information processing device 2.

[0100] (Activity A2)

[0101] The analysis unit 231 of the information processing device 2 analyzes information such as the location of the beauty device 3 or the operation of the user U based on the captured image 51.

[0102] (Activity A3)

[0103] The operation mode of the information processing device 2 is determined by the operation mode determination unit 232 based on the analyzed pattern. The operation mode can be determined by the operation mode determination unit 232 based on a specific operation analyzed by the imaging unit 26, or it can be determined based on a specific action detected by the sensors on the beauty device 3. Furthermore, the operation mode can be determined based on the user U's input operation to the touch panel, or it can be determined based on the user U's voice input instead of the touch panel input operation.

[0104] (Activity A4)

[0105] The transmitting unit 233 of the information processing device 2 sends a switching signal to the beauty device 3 to switch to the determined operating mode.

[0106] (Activity A5)

[0107] The receiving unit 332 of the beauty device 3 receives the switching signal sent by the information processing device 2 during activity A4. Then, the operation control unit 331 controls the operation unit 3a to operate in a predetermined operation mode. When the user U operates the operation button provided on the gripping part 3b of the beauty device 3, the operation control unit 331 can also control the operation mode in the operation unit 3a according to such input operation.

[0108] (Activity A6)

[0109] After user U finishes interacting with beauty device 3, images of user U before and after using beauty device 3, captured by the imaging unit 26 of information processing device 2, are sent to external server 4.

[0110] (Activity A7)

[0111] External server 4 receives images of the beauty device 3 before and after use, sent from information processing device 2 during activity A6. The received images are stored on external server 4, and user U can view the stored images as needed by connecting to server 4.

[0112] [Finish]

[0113] 4. Other

[0114] The present invention can also be implemented in the following ways.

[0115] (1) It can provide a program to enable the computer to function as an information processing device 2.

[0116] (2) It can be provided as a system, including an information processing device 2 and a beauty device 3, which are configured to communicate via telecommunication lines.

[0117] (3) It can also be configured to arbitrarily determine the operation mode based on the user U's operation, in addition to the operation of the touch panel. For example, the analysis unit 231 is configured to analyze the user U's operation based on the image 51 captured by the imaging unit 26, and the operation mode determination unit 232 can be configured to determine the operation mode based on a specific operation included in the operation. In other words, when the user U performs a specific gesture, the information processing device 2 is configured to switch the operation mode based on such gesture. For example, when the user U makes a waving gesture within the shooting range that the imaging unit 26 can capture, it can be configured to switch to a predetermined operation mode, and it can also be configured to switch the operation mode by the user U shaking the beauty device 3 held in his hand up and down.

[0118] (4) Alternatively, the beauty device 3 may have a sensor capable of detecting the user U's operations, and the operation mode determination unit 232 may be configured to determine the operation mode based on a specific operation included in the operation detected by the sensor. The sensor capable of detecting the user U's operations specifically refers to, for example, a motion sensor or a gyroscope sensor, and the specific operation refers to a specific body movement, gesture, or fingertip movement of the user U. For example, the user U's operation of rotating or shaking the beauty device 3 up, down, left, or right. The operation mode determination unit 232 is configured to determine a predetermined operation mode based on such an operation. In this way, when the user U wishes to manually switch the operation mode, they can switch to the desired operation mode without any input operation.

[0119] Furthermore, the present invention can also be provided in various other ways.

[0120] The information processing device is configured to have the camera unit built in.

[0121] In the information processing device, the skin includes the skin of the upper body, which includes at least one of the areas around the face, the neck, and the chest; the analysis unit is configured to analyze the location information of the beauty device from the image, where the location information refers to information about the location of the upper body and / or its state contained in the captured image.

[0122] In the information processing device, the number of upper body parts is configured to be more than 3 and less than 20.

[0123] The information processing apparatus further includes a display unit configured to display an image captured by the imaging unit.

[0124] In the information processing device, the display section is formed on a mirror surface.

[0125] In the information processing device, the display unit is configured to display the name of the operating mode currently in operation of the beauty device.

[0126] In the information processing device, the beauty device is a beauty filter, the skin includes facial skin, and the display unit is configured to display an overlapping image, wherein the overlapping image refers to an image that overlaps the captured image including the user's face with an ideal image including the user's ideal face.

[0127] In the information processing device, the ideal face of the user refers to a symmetrical face generated based on at least a portion of the user's face.

[0128] In the information processing apparatus, the display unit is configured to further overlap and display correction lines on the overlapping image along the boundary of the portion of the user's ideal face.

[0129] In the information processing apparatus, the display unit is configured to magnify and display at least a portion of its display content.

[0130] In the information processing device, the display unit is a touch panel, and the operation mode determination unit is configured to determine the operation mode desired by the user based on the user's input command to the touch panel.

[0131] The information processing device further includes a proposal unit configured to make suggestions to the user regarding the use of the beauty device based on the image.

[0132] In the information processing device, the suggestion is associated with at least one of the operating trajectory, speed, and usage time of the beauty device.

[0133] In the information processing device, the sending unit is configured to send images of the user before and after using the beauty device to an external server.

[0134] In the information processing apparatus, the analysis unit is configured to analyze the user's operation based on the image captured by the imaging unit, and the operation mode determination unit is configured to determine the operation mode based on a specific operation included in the operation analyzed by the analysis unit.

[0135] In the information processing device, the beauty device includes a sensor capable of detecting the user's operations, and the operation mode determination unit is configured to determine the operation mode based on a specific operation included in the operation detected by the sensor.

[0136] A program that enables a computer to function as the information processing device.

[0137] A system includes: an information processing device and a beauty device, configured to communicate via a telecommunication line; the information processing device refers to the information processing unit; the beauty device includes a receiving unit, an operation control unit, and an operation unit; the receiving unit is configured to receive a switching signal from the information processing device; the operation control unit is configured to control the operation unit to operate in a predetermined operation mode according to the switching signal; the operation unit is configured to operate in contact with the user's skin.

[0138] Of course, it's not limited to this.

[0139] Finally, although various embodiments of the present invention have been described, these embodiments are merely illustrative and are not intended to limit the scope of the invention. The present invention can also be implemented through various other embodiments, and any omissions, modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention. Related embodiments or variations should not only be included within the scope or spirit of the present invention, but also within the scope of the invention as described in the claims and their equivalents.

[0140] Brief explanation of symbols

[0141] 1: System

[0142] 2: Information processing device

[0143] 20: Communication bus

[0144] 21: Ministry of Communications

[0145] 22: Storage Department

[0146] 23: Control Department

[0147] 231: Analysis Department

[0148] 232: Operation Mode Determination Department

[0149] 233: Sending Department

[0150] 234: Display Control Unit

[0151] 235: Proposal Department

[0152] 24: Display Section

[0153] 25: Input Section

[0154] 26: Filming Department

[0155] 3: Beauty Device

[0156] 3a: Operations Department

[0157] 3b: Grip section

[0158] 30: Communication bus

[0159] 31: Ministry of Communications

[0160] 32: Storage Department

[0161] 33: Control Department

[0162] 331: Operation Control Department

[0163] 332: Receiving Unit

[0164] 333: Sending Department

[0165] 4: Server

[0166] 5: Overlapping Images

[0167] 51: Image

[0168] 52: Facial Lines

[0169] 53: Eyebrows

[0170] 54: Left eye

[0171] 55: Eyebrows

[0172] 56: Right eye

[0173] 57: Facial Lines

[0174] AD: Recommendation

[0175] IC1: Operation Mode Icon

[0176] IC2: Operation settings icon

[0177] IC3: Highlight icon

[0178] IC4: Operation Assist Icons

[0179] U: User

Claims

1. An information processing apparatus, characterized by, comprising: a display section, an analysis section, an operation mode decision section, a transmission section; the display section is configured to display an image in a form that is visually recognizable by a user, the image being an image that includes a form in which the cosmetic device is in contact with the user's own skin in the use of the cosmetic device and the cosmetic device; the analysis section is configured to determine a part information of the cosmetic device by analyzing the image; the skin includes a skin of an upper body, the upper body including at least one of a face, a neck, and a chest; the part information is a part of the upper body included in the image in the photographing; the operation mode decision section is configured to decide one of a plurality of operation modes of the cosmetic device according to the part information, the operation mode being a form of an operation of the cosmetic device itself that is set in advance to the cosmetic device; the transmission section is configured to transmit a switching signal to switch to the decided operation mode to the cosmetic device, whereby the operation mode can be switched in the use of the user.

2. The information processing device according to claim 1, wherein the photographing section is configured to be built-in.

3. The information processing device according to claim 1, wherein the part of the upper body is configured to be in a number of 3 or more and 20 or less.

4. The information processing device according to claim 1, wherein the display section is configured to be formed on a mirror surface.

5. The information processing device according to claim 1, wherein the display section is configured to display a name of an operation mode in which the cosmetic device is currently operating.

6. The information processing device according to claim 1, wherein the cosmetic device is a beauty device, the skin includes a skin of a face, the display section is configured to display an overlaid image, the overlaid image being an image in which the image in the photographing including the user's face and an ideal image including an ideal face of the user are overlaid and displayed.

7. The information processing device according to claim 6, wherein the ideal face of the user is a face having symmetry that is generated based on at least a part of the user's face.

8. The information processing device according to claim 6, wherein the display section is configured to further display a correction line along a boundary of a part of the ideal face of the user on the overlaid image.

9. The information processing device according to claim 1, wherein the display section is configured to display at least a part of a display content thereof in an enlarged manner.

10. The information processing device according to claim 1, wherein the display section is a touch panel, the operation mode decision section is configured to be able to decide an operation mode desired by the user according to an input instruction of the user to the touch panel.

11. The information processing device according to claim 1, further comprising: a proposal section, the proposal section is configured to propose a suggestion to the user regarding the use of the cosmetic device according to the image.

12. The information processing apparatus according to claim 11, wherein the advice is associated with at least one of an operation trajectory, a speed, and a use time of the cosmetic device.

13. The information processing apparatus according to claim 1, wherein the transmission section is configured to transmit an image before the user uses the cosmetic device and an image after the use to an external server.

14. The information processing apparatus according to claim 1, wherein the analysis section is configured to analyze an operation of the user from an image captured by the imaging section, the operation mode decision section is configured to decide the operation mode based on a specific operation included in the operation analyzed by the analysis section.

15. The information processing apparatus according to claim 1, wherein the cosmetic device includes a sensor capable of detecting an operation of the user, the operation mode decision section is configured to decide the operation mode based on a specific operation included in the operation detected by the sensor.

16. A computer program product, comprising: a computer functioning as the information processing apparatus according to any one of claims 1 to 15.

17. A system, comprising: including: an information processing apparatus and a cosmetic device configured to be capable of communicating through a telecommunication line; the information processing apparatus refers to the information processing apparatus according to any one of claims 1 to 15; the cosmetic device includes a reception section, an operation control section, and an operation section; the reception section is configured to receive the switching signal from the information processing apparatus; the operation control section is configured to control the operation section to operate in a prescribed operation mode according to the switching signal; the operation section is configured to operate in contact with the skin of the user.

Images