Smart glass, depilatory supporting system, and control method of display device in depilatory therapy

Abstract

To provide a depilatory supporting technique which allows a user who receives a depilatory therapy to spend a substantial time during the therapy.SOLUTION: Smart glasses are worn by a user who receives a depilatory therapy, and are capable of displaying a virtual content. The smart glasses comprise a display control unit which displays on a display device a specific virtual content based on surgeon operation information inputted by a surgeon. While the depilatory therapy is performed, the smart glasses worn on the user protects the user's eyes from laser lights and allows the user to enjoy the virtual content displayed on the smart glasses.SELECTED DRAWING: Figure 4A

Description

[Technical Field]

[0001] The present invention relates to smart glasses, a hair removal support system, and a method for controlling a display device in hair removal treatment. [Background technology]

[0002] Regardless of gender, age, etc., people have a strong desire for beauty, especially for their appearance. Hair removal salons (hereinafter simply referred to as "salons") that provide hair removal services are known as facilities that provide full-body beauty services. Salons are equipped with various hair removal devices for hair removal treatments, etc. (See, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-213841 Summary of the Invention [Problem to be solved by the invention]

[0004] During hair removal treatment, the hair removal device emits a strong laser beam. If the laser beam accidentally hits the user's eyes, it could cause blindness. Therefore, the user's eyes are covered with an eye mask or goggles during the treatment.

[0005] As described above, since it is necessary to cover the eyes with an eye mask or goggles during hair removal treatment, many users feel confused about how to spend the time during the treatment. In particular, modern people who are extremely busy have a strong desire not to waste the time required for hair removal treatment, but there is no technology that meets this desire yet.

[0006] Therefore, an object of the present invention is to provide a hair removal support technology that allows users undergoing hair removal treatment to spend a fulfilling time during the treatment. [Means for solving the problem]

[0007] One aspect of the present invention provides smart glasses that are worn by a user undergoing hair removal treatment and are capable of displaying virtual content. The smart glasses are equipped with a display control unit that displays specific virtual content on a display device based on practitioner operation information input by the practitioner. [Effects of the Invention]

[0008] According to the present invention, a user undergoing hair removal treatment can spend a fulfilling time during the treatment. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating an example of a system configuration of a hair removal support system according to an embodiment of the present invention. [Figure 2] FIG. 1 is a diagram illustrating an example of the main hardware configuration of a therapist terminal, a user terminal, smart glasses, and a server device. [Figure 3] FIG. 2 is a diagram illustrating an example of a main functional block configuration of a therapist terminal. [Figure 4A] 10A to 10C are diagrams showing examples of screens corresponding to the respective functions. [Figure 4B] 10A to 10C are diagrams showing examples of screens corresponding to the respective functions. [Figure 4C] 10A to 10C are diagrams showing examples of screens corresponding to the respective functions. [Figure 4D] 10A to 10C are diagrams showing examples of screens corresponding to the respective functions. [Figure 5] FIG. 2 is a diagram illustrating an example of a main functional block configuration of a user terminal. [Figure 6] FIG. 1 is a diagram illustrating an example of a main functional block configuration of smart glasses. [Figure 7] FIG. 2 is a diagram illustrating an example of a main functional block configuration of a server device. [Figure 8] 10 is a flowchart illustrating an operation of the server device. DETAILED DESCRIPTION OF THE INVENTION

[0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described with reference to the accompanying drawings, in which the same reference numerals denote the same or similar components.

[0011] <Overview of Technology Relating to the Present Disclosure> The technology relating to the present disclosure utilizes, for example, smart glasses for AR (Augmented Reality) or VR (Virtual Reality) as a hair removal support tool. By having a user wear the smart glasses during hair removal treatment, the user's eyes can be protected from laser light while the user enjoys virtual content displayed on the smart glasses.

[0012] 1 is a diagram showing an example of the system configuration of a hair removal support system 100 according to this embodiment. The hair removal support system 100 includes a hair removal device 10, a practitioner terminal 20, a user terminal 30, smart glasses 40, and a server device 50.

[0013] The hair removal device 10, practitioner terminal 20, user terminal 30, smart glasses 40, and server device 50 are interconnected via a communication network N. The communication network N refers to a communication path that allows data communication, and includes a dedicated line (dedicated cable) for direct connection, a LAN (Local Area Network) such as Ethernet (registered trademark), a telephone communication network, a cable network, the Internet, and other communication networks, and the communication method can be either wired or wireless.

[0014] The hair removal device 10 is configured, for example, as a laser hair removal device capable of outputting laser beams of various wavelengths, and is installed in each salon where hair removal treatments are performed. The hair removal device 10 is used by the practitioner to remove hair from areas such as beards, arms, and legs according to the user's request.

[0015] The therapist terminal 20 is a terminal through which the therapist inputs various instructions related to the treatment, and also inserts information about the treatment, advertisements, etc. (details will be described later) into various virtual contents (still images, video data, etc.) played on the smart glasses 40. The therapist terminal 20 can be any terminal with a communication function, such as a laptop PC, personal computer, smartphone, tablet terminal, or mobile phone.

[0016] The user terminal 30 is operated by the user receiving hair removal treatment and is used to acquire various information about the user during the treatment (and / or before and after the treatment). The user terminal 30 is equipped with various controls OP (e.g., operation buttons, switches, etc.) that the user can operate, and a biosensor BS for detecting the user's biometric information (e.g., heart rate, body temperature, acceleration, pressure, etc.). The user terminal 30 can be any terminal equipped with controls OP, a biosensor BS, and a communication function, and can be configured, for example, as a dedicated or general-purpose tablet terminal or a personal computer. The user terminal 30 may be installed in a location where the user can operate it during treatment (e.g., near the treatment bed). The user terminal 30 may be handed over to the salon by the user receiving it from the salon at the end of the reception and returning it to the salon after the treatment is completed.

[0017] The smart glasses 40 are configured, for example, as AR glasses or VR glasses shaped like glasses. The display (display device) of the smart glasses 40 corresponds to the lens portion of the glasses and displays desired virtual content according to instructions from the practitioner or user. The smart glasses 40 may be configured with a light-blocking sponge eye mask or the like to reliably protect the user's eyes during treatment. The smart glasses 40 are equipped with a camera, various sensors, buttons, speakers, controllers, etc., which will be described later, and are capable of wired or wireless connection to the outside. The smart glasses 40 may also be an HMD (Head Mounted Display) that the user can wear on their head.

[0018] The server device 50 controls the virtual content to be displayed on the smart glasses 40 in accordance with various instructions transmitted from the therapist terminal 20 and the user terminal 30. The server device 50 may be configured by one or more servers, or may be configured by using a cloud server.

[0019] As will be described in detail later, the server device 50 not only plays (displays) specific virtual content desired by the user (for example, beauty video content) on the smart glasses 40, but also superimposes and displays treatment support information (for example, "Please look to the right") and advertising information (for example, "Recommended products from XX salon!") on the virtual content being played. The treatment support information, advertising information, etc. can be selected by the therapist using the therapist terminal 20. For ease of explanation, the treatment support information, advertising information, etc. superimposed and displayed on the virtual content will be collectively referred to as "sub-content information" below.

[0020] <Hardware Configuration> FIG. 2 is a diagram showing an example of the main hardware configuration of the therapist terminal 20, the user terminal 30, the smart glasses 40, and the server device 50.

[0021] The practitioner terminal 20, the user terminal 30, the smart glasses 40, and the server device 50 each include a processor 1, a memory 2, a storage device 3, a communication device 4 for wired or wireless communication, an input device 5, an output device 6, and the like.

[0022] The processor 1 is, for example, a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), and controls the entire device.

[0023] The memory 2 is configured by, for example, a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Erasable Programmable ROM), and / or a RAM (Random Access Memory).

[0024] The storage device 3 is configured by storage such as a hard disk drive (HDD), a solid state drive (SSD), and / or an embedded multi media card (eMMC).

[0025] The communication device 4 is a device that performs communication via a wired and / or wireless network, and is, for example, a network card, a communication module, or the like.

[0026] The input device 5 is, for example, an operation button, a touch panel, and / or a microphone, and the output device 6 is, for example, a display and / or a speaker.

[0027] In addition to these hardware components, the smart glasses 40 may also include a camera CA. The camera CA is provided, for example, at the end of the frame of the smart glasses 40, and captures an image of real space included in the field of view of a user wearing the smart glasses 40. The camera CA may be configured using a solid-state imaging element, such as a CCD (Charge Coupled Devices) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor.

[0028] <Functional Block Configuration> (Practitioner Terminal 20) Figure 3 is a diagram showing an example of the main functional block configuration of practitioner terminal 20. Practitioner terminal 20 includes a storage unit 210, an instruction input unit 220, and a communication unit 230. The storage unit 210 may be realized by storage device 3, and the instruction input unit 220 may be realized by processor 1 in addition to input device 5 executing a program stored in storage device 3. The communication unit 230 may be realized by communication device 4, or may be realized by processor 1 in addition to communication device 4 executing a program stored in storage device 3.

[0029] The storage unit 210 stores various control programs and various data. The control programs include an application program for salons (hereinafter referred to as "salon app") AP1. The massager terminal 20 realizes the following various functions by executing the salon app AP1. FIGS. 4A to 4D show example screens corresponding to each function that are displayed on the display D of the massager terminal 20.

[0030] (1) Stamp Function The stamp function is a function for superimposing (i.e., stamping) treatment support information, such as "Turn right" or "Turn left," on the virtual content being viewed by the user (see FIG. 4A). The display D of the therapist terminal 20 displays the virtual content VC being viewed by the user. The therapist operates the stamp button B1 or the like as appropriate, depending on, for example, the area to be treated. When the stamp button B1 is operated, the therapist terminal 20 sends an instruction to the server device 50 to superimpose the selected stamp SP (e.g., "Open your left leg outward") on the virtual content VC being viewed by the user. Upon receiving this instruction, the server device 50 displays the selected stamp SP superimposed on the virtual content VC being viewed by the user (see FIG. 4A). The stamp function enables the therapist to visually and clearly communicate body movements, which are difficult to convey to the user. Here, the stamp SP is used as an example of treatment support information, but the present invention is not limited to this. The therapist may create an original message (text, voice, etc.) and display (or output) this as treatment support information superimposed on the virtual content VC.

[0031] (2) Advertisement selection function The advertisement selection function selects and inserts (replays) advertisements that the user is likely to be interested in for the virtual content that the user is viewing. This function is for generating advertisements (see FIG. 4B). The therapist operates the advertisement selection button B2 as appropriate to select an advertisement commercial that is likely to interest the user, based on the conversation that has taken place with the user and the user's personal information (e.g., age, gender, survey results, etc.). When this operation is performed, the therapist terminal 20 sends an instruction to the server device 50 to insert the selected advertisement commercial (e.g., "XX cosmetics are the best!") into the virtual content VC that the user is viewing. Upon receiving this instruction, the server device 50 inserts the selected advertisement commercial into the virtual content VC that the user is viewing and displays it. At some point after the treatment, the server device 50 may introduce to the terminal held by the user a web page that allows access to a site related to the viewed advertisement (e.g., an e-commerce site of a cosmetics manufacturer).

[0032] (3) User Personal Information Confirmation Function The user information confirmation function is a function for confirming the personal information of the user currently receiving treatment (see FIG. 4C). The therapist operates the customer information button B3 or the like. When this operation is performed, the therapist terminal 20 sends an instruction to the server device 50 to display the personal information PI of the user currently receiving treatment on the display D. The server device 50 receives this instruction and displays the personal information PI of the user currently receiving treatment on the display D. The personal information PI includes not only basic information such as the user's date of birth, address, number of visits, and genres of interest, but also viewing history information indicating the history of virtual content the user has viewed and memo information recorded by the therapist in charge of the user's past visits. The viewing history information may include information for displaying the viewing history for a predetermined period (e.g., the past year) in chronological order, and the memo information may include information for displaying the user's preferences, concerns, personality, etc. The viewing history information, memo information, etc. are stored in the storage unit 210.

[0033] (4) User Switching Function The user switching function is a function for identifying (setting) the user currently receiving treatment from among multiple users who have visited the salon (see FIG. 4D). The therapist sets the user currently receiving treatment by operating the customer switching button B4 or the like. When this operation is performed, the therapist terminal 20 sends an instruction to the server device 50 to set the user currently receiving treatment from among multiple users. Upon receiving this instruction, the server device 50 switches the status ST of the user currently receiving treatment to "setting" and displays it on the display D.

[0034] (5) Conversation Recording Function The conversation recording function is a function for recording a conversation between, for example, a therapist and a user. The therapist operates a predetermined button to set the start or end of conversation recording. When this operation is performed, the therapist terminal 20 sends an instruction to the server device 50 to start or end recording the conversation. The server device 50 receives this instruction and starts or ends recording the conversation. The server device (recording unit) 50 stores (records) conversation information indicating the content of the conversation in association with each user in a database or the like, and sends the conversation information to the therapist terminal 20. The therapist terminal (recording unit) 20 stores (records) the conversation information in the storage unit 210. Note that instead of a button operation by the therapist, the therapist terminal 20 may detect the start or end of a conversation between the therapist and the user, and automatically start or end recording the conversation.

[0035] (6) Personal Information Extraction Function The personal information extraction function is a function for analyzing, for example, a conversation between a therapist and a user, and extracting the user's personal information (specifically, the user's hobbies, areas of interest, family structure, number of treatments received, etc.) based on the analysis results. When the therapist terminal 20 acquires conversation information using the conversation recording function, it sends an instruction to the server device 50 to analyze the conversation information and extract the user's personal information. The server device (extraction unit) 50 receives this instruction and extracts the user's personal information. When the server device (recording unit) 50 extracts the user's personal information, it associates the extracted user's personal information with the conversation information and stores (records) it in a database or the like, and sends it to the therapist terminal 20. The therapist terminal (recording unit) 20 associates the user's personal information with the conversation information and stores (records) it in the memory unit 210. Note that the therapist terminal 20 may itself perform the recording of the conversation and the extraction of personal information.

[0036] In addition to the functions (1) to (6) described above, the salon app AP1 also provides various other functions, such as an account setting function for setting up a unique account for each salon, and a notification function for providing the latest news (notifications). For the sake of convenience, the various functions provided by the salon app AP1 will be collectively referred to as "extended functions" below.

[0037] 3, the instruction input unit 220 receives input of various operation instructions from the practitioner and outputs them as practitioner operation information to the communication unit 230. The communication unit 230 exchanges various information including the practitioner operation information with the server device 50.

[0038] (User Terminal 30) Fig. 5 is a diagram showing an example of the main functional block configuration of the user terminal 30. The user terminal 30 includes a storage unit 310, a sensor unit 320, an instruction input unit 330, and a communication unit 340. The storage unit 310 may be realized by the storage device 3, the sensor unit 320 may be realized by the biosensor BS, and the instruction input unit 330 may be realized by the processor 1 executing a program stored in the storage device 3 in addition to the operator OP. The communication unit 340 may be realized by the communication device 4, or may be realized by the processor 1 executing a program stored in the storage device 3 in addition to the communication device 4.

[0039] The memory unit 310 stores various control programs and various data. The sensor unit 320 is attached to the user during treatment (or before and after treatment). When the biosensor BS detects the user's biometric information (e.g., heart rate, body temperature, etc.), it outputs this to the communication unit 340. The instruction input unit 330 accepts various operation instructions from the user and outputs them to the communication unit 340 as user operation information. The user operation information includes information conveying the user's pain and intentions regarding the treatment (e.g., pain intensity of hair removal and adjustment of laser output). The communication unit 340 exchanges various information, including biometric information and user operation information, with the server device 50. The biometric information and user operation information (treatment-related information) are transmitted from the server device 50 to the practitioner terminal 20 and displayed on the display of the practitioner terminal 20. If the practitioner determines that the user is in pain from the biometric information and user operation information displayed on the display, for example, the practitioner can suggest to the user that the treatment content be changed, thereby enabling a treatment that is more tailored to the user.

[0040] (Smartglasses 40) Fig. 6 is a diagram showing an example of the main functional block configuration of the smartglasses 40. The smartglasses 40 include a control unit 410, an image acquisition unit 420, a display control unit 430, and a communication unit 440. The control unit 410 and the display control unit 430 may be realized by the processor 1 executing a program stored in the storage device 3, and the image acquisition unit 420 may be realized by the processor 1, in addition to the camera CA, executing a program stored in the storage device 3.

[0041] The control unit 410 comprehensively controls each unit of the smart glasses 40. The image acquisition unit 420 acquires an image of the real space captured by the camera CA as imaging data. The image acquisition unit 420 outputs the acquired imaging data to the display control unit 430. The display control unit 430 controls the display of virtual content on the display, and when imaging data is acquired by the camera CA, controls the display of the imaging data superimposed on the virtual content. The communication unit 440 exchanges various information including virtual content with the server device 50.

[0042] (Server Device 50) Fig. 7 is a diagram showing an example of a main functional block configuration of server device 50. Server device 50 includes a storage unit 510, a control unit 520, and a communication unit 530. Storage unit 510 may be realized by storage device 3, and control unit 520 may be realized by processor 1 executing a program stored in storage device 3. Communication unit 530 may be realized by communication device 4, or may be realized by communication device 4 and processor 1 executing a program stored in storage device 3.

[0043] The storage unit 510 stores various control programs and various data. The control programs include an application program (hereinafter referred to as "operation app") AP2 for an administrator who operates the system 100. The server device 50 executes the operation app AP2 to centrally manage the operations of the therapist terminal 20, the user terminal 30, and the smart glasses 40.

[0044] The storage unit 510 includes a user database DB1, a salon database DB2, a virtual content database DB3, a sub-content database DB4, and an EC-related database DB5.

[0045] The user database DB1 stores, for each user who is a salon customer, a user ID, name, address, telephone number, email address, etc., as well as the personal information of each user (i.e., basic information, viewing history information, memo information, etc.) as previously described. The salon database DB2 stores, for each salon, a salon ID, address, telephone number, email address, practitioner, information on the installed hair removal device 10, etc.

[0046] The virtual content database DB3 stores a content ID, content genre, content data, etc. for each virtual content. The content data is provided by, for example, a content provider (not shown). There are no particular restrictions on the content genre, but examples include beauty, golf, English conversation, variety, and healing.

[0047] The sub-content database DB4 stores sub-content information to be displayed superimposed on the virtual content, such as treatment support information, advertising information, etc. The EC-related database DB5 stores information related to sales of beauty products, for example.

[0048] The control unit 520 comprehensively controls each unit of the server device 50. The control unit 520 also controls the display of virtual content in accordance with instructions sent from the therapist terminal 20, the user terminal 30, etc. The communication unit 530 exchanges various information related to the display of virtual content between the therapist terminal 20 and the user terminal 30.

[0049] Hereinafter, the operation of the hair removal support system 100 when the user views virtual content during the hair removal treatment process will be described with reference to the drawings.

[0050] 8 is a flowchart showing the operation of the server device 50. It is assumed that the user has been accepted and preparations for treatment have been completed.

[0051] After explaining the treatment details to the user, the therapist confirms with the user the virtual content they would like to view during the treatment. After confirming the virtual content desired by the user (hereinafter referred to as desired content), the therapist operates the therapist terminal 20 to specify the desired content from among multiple pieces of virtual content. The therapist terminal 20 sends an instruction to the server device 50 to play the desired content. Meanwhile, once the therapist confirms that the user has put on the smart glasses 40 and is ready for the treatment, the therapist starts the treatment.

[0052] When the server device 50 receives an instruction to play the desired content from the therapist terminal 20 (step S1), it accesses the virtual content database DB3 and acquires the content data of the desired content (step S2). The server device 50 transmits the acquired content data of the desired content to the smart glasses 40 via the user terminal 30 (or without passing through the user terminal 30) (step S3). When the smart glasses 40 receive the content data of the desired content, By playing the content data, the desired content is displayed on the display. By viewing the desired content displayed on the display, the user is not only able to reduce the pain and anxiety of the treatment, but also to spend a fulfilling time.

[0053] When an instruction to execute the extended function shown in (1) to (6) above is received from the therapist terminal 20, the server device 50 executes processing related to the instructed extended function. Details of the processing content related to the extended function have already been made clear, so further explanation will be omitted.

[0054] As described above, according to this embodiment, by wearing the smart glasses during hair removal treatment, the user can protect their eyes from laser light while viewing the desired virtual content displayed on the smart glasses. This not only reduces the pain and anxiety of the treatment, but also allows the user to spend a fulfilling time.

[0055] B. Modifications Although not specifically mentioned in the above-described embodiment, a user may be charged according to the type and number of virtual content provided to the user. The user accesses the server device 50 using a terminal (e.g., a smartphone) owned by the user, selects the virtual content they wish to view (i.e., desired content), and is charged according to the content. Upon accepting the user's payment, the server device (reception unit) 50 transmits content data of the desired content to the smart glasses 40 via the user terminal 30 (or without passing through the user terminal 30). Upon receiving the content data of the desired content, the smart glasses (display control unit) 40 display the desired content according to the fee on the display based on the received content data. This allows the user to view virtual content according to their preferences. Note that virtual content that can be viewed for free and virtual content that can be viewed for a fee may be provided, allowing the user to select either one.

[0056] In the above-described embodiment, hair removal treatment is used as an example of a cosmetic treatment, but the present invention is not limited to this. For example, the present invention can be applied to any cosmetic treatment or medical treatment, such as slimming treatment, skin care treatment, or massage treatment.

[0057] The above-described embodiments are intended to facilitate understanding of the present invention and are not intended to limit the present invention. The flowcharts, sequences, elements included in the embodiments, as well as their arrangements, materials, conditions, shapes, sizes, etc., are not limited to those exemplified and may be modified as appropriate. [Explanation of symbols]

[0058] 100...hair removal support system, 10...hair removal device, 20...practitioner terminal, 210...memory unit, AP1...salon app, 220...instruction input unit, 230...communication unit, D...display, VC...virtual content, SP...stamp, B1...stamp button, B2...advertisement selection button, B3...customer information button, B4...customer switching button, 30...user terminal, OP...operator, BS...biometric sensor, 310...memory unit, 320...sensor unit, 330...instruction input unit, 340...communication unit, 40...smart Glasses, 410...control unit, 420...image acquisition unit, 430...display control unit, 440...communication unit, 50...server device, 510...storage unit, 520...control unit, 530...communication unit, AP2...operation application, DB1...user database, DB2...salon database, DB3...virtual content database, DB4...sub-content database, DB5...EC-related database, 1...processor, 2...memory, 3...storage device, 4...communication device, 5...input device, 6...output device, CA...camera

Claims

1. The smart glasses are worn by a user undergoing hair removal treatment and are capable of displaying virtual content, and are equipped with a display control unit that displays specific virtual content on a display device based on practitioner operation information input by the practitioner.

2. The smart glasses according to claim 1 , further comprising a selection unit that selects the specific virtual content from a plurality of virtual contents based on the practitioner operation information, and the display control unit displays the selected specific virtual content on a display device.

3. A hair removal support system comprising the smart glasses according to claim 1 and a user terminal that transmits treatment-related information relating to the user's hair removal treatment to a practitioner terminal.

4. The hair removal support system according to claim 3 , further comprising a storage unit that stores a history of the virtual content displayed on the display device during the hair removal treatment of the user as display history information.

5. The hair removal support system according to claim 3 or 4, further comprising a recording unit that records a conversation between the user and the practitioner as conversation information.

6. The hair removal support system according to claim 5, further comprising an extraction unit that extracts personal information of the user by analyzing the conversation information, and the recording unit records the extracted personal information and the conversation information in association with each other.

7. The smart glasses according to claim 1 or 2, further comprising: a reception unit that receives a charge from the user; and the display control unit that displays the specific virtual content according to the charge on the display device.

8. The smart glasses according to claim 1 or 2, further comprising a camera, wherein the display control unit displays imaging data acquired by the camera on the display device.

9. A control method for a display device visible to a user undergoing hair removal treatment, the control method including a step of displaying specific virtual content on the display device based on operation information input by the practitioner.

Images