Display device using magnetic fluid

Abstract

[Problem] To provide a display device capable of interactive display using a magnetic fluid. [Solution] A display device 2A using a magnetic fluid is used, for example, while being affixed to an indoor wall surface W, and electric power is supplied thereto from an outlet 4. The display device 2A comprises: a magnetic force generation part which generates magnetic force; a display body 12 into which a magnetic fluid and a nonmagnetic fluid are sealed; and a control board as a control part which controls the magnetic force generation part on the basis of input information from the dialogist H side to change the shape of the magnetic fluid. For example, when the dialogist H utters "I'm back!", voice data based on the utterance of "I'm back!" of the dialogist H is inputted by a voice recognition means through a microphone 30 built in the display body 12, the magnetic force generation part is driven by display data created on the basis of the voice data, the magnetic fluid is changed, and a response display such as "Welcome back!" is performed.

Description

Display device using magnetic fluid

[0001] The present invention relates to a display device using a magnetic fluid, and more particularly to a display device capable of interactive display that enables communication with a conversational partner and visual display of the speaker's emotions, etc.

[0002] When a magnetic field is applied to a magnetic fluid sealed in a glass case, as described in Patent Document 1, disturbances occur at the interface of the magnetic fluid and the strength of the magnetic field fluctuates. Because magnetic field lines tend to concentrate at the peaks of the wave front, magnetization at the peaks increases and magnetization at the valleys decreases. The deformation progresses to a point where the magnetic pressure, gravity, and surface tension are balanced, eventually forming a three-dimensional structure of regularly arranged protrusions (cones) called spikes, which stabilize. The various spike shapes maintained by this magnetic force provide viewers with a unique aesthetic that cannot be perceived with ordinary fluids. As disclosed in Patent Documents 1 and 2, etc., these are considered aesthetically pleasing, and improving aesthetic appeal is a technological trend.

[0003] On the other hand, as disclosed in Patent Document 3 and Patent Document 4, display devices have been proposed in which electromagnets are arranged in a matrix and the position at which a magnetic field is applied is controlled to display letters, numbers, figures, etc. Patent Document 3 describes applying a magnetic field from the back of a storage tray in which a magnetic fluid is stored, causing the magnetic fluid to partially bulge, thereby forming letters, figures, etc. Patent Document 4 describes utilizing the property of magnetic microparticles that align along the direction of magnetic field action to transmit light, and selectively applying a magnetic field according to image information to the magnetic fluid, thereby creating both light-transmitting and non-light-transmitting areas (areas where the magnetic field does not act), thereby forming letters, figures, etc. with the transmitted light. Also known is a sealing structure using a magnetic fluid.

[0004] International Publication No. 2016 / 027535 JP 2018-155524 JP 2005-91759 A JP 7-146659 A

[0005] As mentioned above, magnetic fluids are used in a variety of fields, but their use is limited to simply changing the shape of a magnetic field by changing the position or strength of the applied magnetic field. In other words, they merely utilize the basic properties of magnetic fluids, which react to magnetic fields. In other words, their use is "unidirectional," allowing humans to enjoy the shape changes caused by the basic properties of magnetic fluids and to recognize the displayed content. Patent Document 3 also describes the possibility of inputting voice from a microphone or other device and converting the voice data into text for display, which may suggest a broader range of uses. However, in this case, the display data is input by voice, and the use remains unidirectional.

[0006] If the magnetic fluid can be made to change and even respond to input information from the person viewing the display device, it can be expected to be used as a communication tool with humans (two-way communication), which will contribute to expanding the fields of use.

[0007] The present invention has been made in consideration of the above points, and its purpose is to provide a display device that is capable of interactive display using magnetic fluid and visual display of the speaker's emotions, etc., in order to contribute to expanding the field of use.

[0008] In order to achieve the above object, the display device (2A) using the magnetic fluid of the present invention is characterized by having a magnetic force generating unit (6) that generates magnetic force, a display body (12) in which a magnetic fluid (8) and a non-magnetic fluid (10) are sealed, and a control unit (14A) that controls the magnetic force generating unit (6) based on input information from the interlocutor (H) and changes the shape of the magnetic fluid (8).

[0009] According to the display device using the magnetic fluid of the present invention, a response display can be made based on input information from the interlocutor, thereby enabling communication to be established between the interlocutor and the display device, thereby expanding the range of applications.

[0010] Furthermore, in the display device (2A) using the magnetic fluid, the control unit (14A) may include a voice recognition means (38), and the control unit (14A) may change the shape of the magnetic fluid (8) based on data recognized by the voice recognition means (38). In this way, a response display is made in response to the speech of the interlocutor, making communication easy and smooth.

[0011] In addition, in the display device (2B) using the magnetic fluid, the control unit (14B) may change the shape of the magnetic fluid (8) based on the biometric information of the interlocutor (H), which makes it possible to use the device as a product for monitoring the health condition of the interlocutor (H).

[0012] The display device (2B) using the magnetic fluid may further include a receiving device (46) for receiving biometric data transmitted from an external device, and the control unit (14B) may change the shape of the magnetic fluid (8) based on the data input via the receiving device (46). This allows for easy and smooth exchange of data on the health status of the interlocutor.

[0013] In addition, in the display device (2B) using the magnetic fluid, the biometric data may be heart rate data transmitted from a wearable device (44). This allows data to be transmitted from a device worn on the body, making it easy and smooth to exchange data on the health status of the interlocutor.

[0014] Furthermore, in the display device (2C) using the magnetic fluid, the display body (12) may include a non-contact thermometer (50), and the control unit (14C) may change the shape of the magnetic fluid (8) based on the value measured by the non-contact thermometer (50). This allows the interlocutor to input biometric information into the display device simply by bringing their foreheads close to the display device, thereby improving usability.

[0015] In addition, in the display device (2D) using the magnetic fluid, the display body (12) may be equipped with a pulse oximeter (52), and the control unit (14D) may change the shape of the magnetic fluid (8) based on the value measured by the pulse oximeter (52). This makes it easy and smooth to exchange data on the health status of the interlocutor.

[0016] Furthermore, in the display device (2E) using the magnetic fluid, the display body (12) is equipped with a camera (54), and the control unit (14E) has image analysis means (56) for analyzing changes in facial expression from images captured by the camera (54), and the shape of the magnetic fluid (8) may be changed based on changes in the facial expression of the interlocutor (H) analyzed by the image analysis means (56). This allows the interlocutor's level of fatigue to be grasped, making it possible to encourage him or her and improving emotional communication capabilities.

[0017] In addition, in the display devices (2A to 2E) using the magnetic fluid, the control unit (14A to 14E) may change the shape of the magnetic fluid (8) into letters, thereby ensuring that the content of the response can be transmitted to the interlocutor.

[0018] Furthermore, in the display devices (2A-2E) using the magnetic fluid, the control unit (14A-14E) may change the shape of the magnetic fluid (8) to a shape corresponding to the input information data, thereby making it possible to easily display expressions that are difficult to convey using text using simple graphics, etc.

[0019] Furthermore, the display device (2F) using the magnetic fluid of the present invention comprises a magnetic force generating unit (6) that generates magnetic force, a display body (12) in which a magnetic fluid (8) and a non-magnetic fluid (10) are sealed, a voice generating unit (31) that emits voice, and a control unit (14A) that controls the voice generating unit (31) and the magnetic force generating unit (6) based on input information from the interlocutor (H), and the control unit (14A) determines the words to reply to the interlocutor (H) and the emotion to be expressed when replying based on the input information from the interlocutor (H), and based on the determination, controls the voice generating unit (31) to output a reply voice that indicates the emotion toward the interlocutor (H), and controls the magnetic force generating unit (6) to change the magnetic fluid (8) to a shape that indicates the emotion toward the interlocutor (H).

[0020] This display device using magnetic fluid can simulate emotional expressions by changing the shape and movement of the magnetic fluid in response to the voice of the interlocutor, simultaneously with the response voice from the voice generating unit. In other words, when the interlocutor speaks to the display device, the display device can express emotions by changing the shape and movement of the magnetic fluid in conjunction with the response voice from the voice generating unit, allowing the interlocutor to enjoy the sensation of communicating with a human or pet with emotions.

[0021] Furthermore, in the display device (2F) using the magnetic fluid described above, the control unit (14A) and the magnetic force generating unit (6) may change the strength of the magnetic force applied to the magnetic fluid (8) according to the emotion expressed when replying, thereby changing the magnetic fluid (8) to take a shape that indicates the emotion toward the interlocutor (H).

[0022] Furthermore, in the display device (2F) using the above-mentioned magnetic fluid, the control unit (14A) may control the magnetic force generating unit (6) to change the strength of the magnetic force applied to the magnetic fluid (8) while emitting a sound from the sound generating unit (31), thereby simultaneously uttering a reply to the interlocutor (H) and expressing an emotion by changing the shape of the magnetic fluid (8).

[0023] Furthermore, in the display device (2F) using the magnetic fluid described above, the control unit (14A) and the magnetic force generating unit (6) may apply a relatively weak magnetic force to the magnetic fluid (8) when the emotion expressed in the reply is mild, compared to when the emotion is strong anger, surprise, or the like.

[0024] Furthermore, in the display device (2F) using the magnetic fluid described above, the control unit (14A) and the magnetic force generating unit (6) may apply a relatively stronger magnetic force to the magnetic fluid (8) when the emotion expressed in the reply is strong anger or surprise, compared to when the emotion is mild.

[0025] Furthermore, the display device (2F) using the above-mentioned magnetic fluid may be provided with a voice input means (30) for inputting the voice of the interlocutor (H) as input information from the interlocutor (H) side, and the control unit (14A) may determine the words to reply to the interlocutor (H) and the emotions to be expressed when replying based on the voice input from the voice input means (30).

[0026] Furthermore, the display device (2F) using the above-mentioned magnetic fluid may be provided with a receiving device (46) that receives biometric information data transmitted from an external device (44) as input information from the interlocutor (H), and the control unit (14A) may determine the words to reply to the interlocutor (H) and the emotions to be expressed when replying based on the data input via the receiving device (46).

[0027] In addition, in the display device (2F) using the magnetic fluid, the bioinformation data may be heart rate data transmitted from a wearable device (44) that is an external device (44).

[0028] Furthermore, the display device (2F) using the magnetic fluid described above may be provided with a non-contact thermometer (50) that measures the body temperature of the interlocutor (H) as input information from the interlocutor (H), and the control unit (14A) may determine the words to reply to the interlocutor (H) and the emotions to be expressed when replying based on the value measured by the non-contact thermometer (50).

[0029] Furthermore, the display device (2F) using the above-mentioned magnetic fluid is provided with a camera (54) capable of taking an image of the interlocutor (H) as input information from the interlocutor (H), and the control unit (14A) has an image analysis means (56) that analyzes changes in the interlocutor (H)'s facial expression from the image taken by the camera (54), and may determine the words to reply to the interlocutor (H) and the emotions to be expressed when replying based on the changes in the interlocutor's facial expression analyzed by the image analysis means (56).

[0030] According to the present invention, it is expected that the present invention can be used as a communication tool (two-way communication) with an interlocutor, and can contribute to the expansion of fields of use.

[0031] 1 is a perspective view showing a state in use of a display device using a magnetic fluid according to a first embodiment of the present invention. FIG. 1 is a schematic cross-sectional view taken along line X-X in FIG. 1. FIG. 2 is a plan view of an electromagnet array in the display device shown in FIG. 1. FIG. 3 is a side view showing one electromagnet in the electromagnet array shown in FIG. 3. FIG. 4 is an enlarged view of a main part for explaining the mechanism of display using a magnetic fluid in the display device shown in FIG. 1. FIG. 5 is a control block diagram of a display device according to a second embodiment. FIG. 6 is a front view showing an example of a response display of the display device according to the second embodiment. FIG. 7 is a control block diagram of a display device according to a third embodiment. FIG. 8 is a control block diagram of a display device according to the third embodiment. FIG. 9 is a front view of a display device according to a fourth embodiment. FIG. 10 is a control block diagram of a display device according to the fourth embodiment. FIG. 11 is a control block diagram of a display device according to a fifth embodiment. FIG. 12 is a control block diagram of a display device according to the fifth embodiment. FIG. 13 is a front view of a display device according to a sixth embodiment. FIG. 14 is a control block diagram of a display device according to the sixth embodiment. FIG. 15 is a diagram showing a specific example of a change in shape of a magnetic fluid. FIG. 16 is a timing chart showing a specific example of a response voice from a speaker, a change in magnetic force applied to the magnetic fluid, and a corresponding change in shape of the magnetic fluid. FIG. 17 is a timing chart showing a specific example of a response voice from a speaker, a change in magnetic force applied to the magnetic fluid, and a corresponding change in shape of the magnetic fluid. FIG. 10 is a timing chart showing a specific example of a reply voice from a speaker, a change in magnetic force applied to the magnetic fluid, and a resulting change in the shape of the magnetic fluid. FIG. 11 is a timing chart showing a specific example of a reply voice from a speaker, a change in magnetic force applied to the magnetic fluid, and a resulting change in the shape of the magnetic fluid. FIG. 12 is a timing chart showing a specific example of a reply voice from a speaker, a change in magnetic force applied to the magnetic fluid, and a resulting change in the shape of the magnetic fluid. FIG. 13 is a front view of a display device according to a seventh embodiment. FIG. 14 is a control block diagram of a display device according to the seventh embodiment.

[0032] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0033] First Embodiment A first embodiment will be described with reference to FIGS. 1 to 6. As shown in FIG. 1, a display device 2A capable of interactively displaying information using a magnetic fluid according to this embodiment (hereinafter simply referred to as the "display device") is fixed to, for example, a wall W in a room and receives power (commercial power) from an outlet 4. As shown in FIG. 2, the display device 2A includes a magnetic force generating unit 6 that generates magnetic force, a display body 12 containing a magnetic fluid 8 and a non-magnetic fluid 10, and a control board 14A as a control unit that controls the magnetic force generating unit 6 and changes the shape of the magnetic fluid 8 based on input information from the interlocutor H. Note that "changing the shape of the magnetic fluid 8" as used herein refers to changing the shape of the magnetic fluid 8 to characters, shapes, or a combination of these. While the outlet 4 is used as an example of the power source for the display device 2A, other power sources may also be used. For example, since the driving power of the magnetic fluid is relatively small, the power supply source for the display device 2A may be a built-in battery system, a solar cell system, a USB power supply system, etc. Such a power supply system allows the display device 2A to be easily used in places in the house where there are no outlets or where the wiring from the outlet is difficult to reach, and the display device 2A can also be carried around, eliminating restrictions on where it can be used.

[0034] The magnetic force generator 6 includes an electromagnet array 16 and a circuit board 18 that selectively energizes (excites) each electromagnet 36 (see FIG. 3 ) in the electromagnet array 16. The display 12 includes a transparent glass plate 20 that forms the display surface, a glass plate 22 that faces the glass plate 20 at a distance, a rubber seal member 24 that seals the periphery between the glass plates 20 and 22, and a frame 26 that covers these components. Reference numeral 28 denotes a spacer. A magnetic fluid 8 and a non-magnetic fluid 10 are sealed in the sealed space between the glass plates 20 and 22, and the electromagnet array 16 is disposed on the back side of the glass plate 22. A microphone 30 that picks up the voice of the interlocutor H is built into the center of the upper end of the display 12. The lower end of the glass plate 20 that forms the display surface is masked with a color coating 32 (shown hatched) to prevent the settling and volumetric state of the magnetic fluid 8 from being visible from the outside. The front surface of the glass plate 22 is coated with a white coating that allows magnetic lines of force to pass through in order to improve the display quality (contrast) of the black magnetic fluid 18 .

[0035] As shown in FIG. 3, the electromagnet array 16 has a configuration in which a large number of electromagnets 36, each having a cylindrical outer shell, are arranged in a matrix on a base plate 34. As shown in FIG. 4, each electromagnet 36 is formed as an air-core coil, with arrow i indicating the direction of current and arrow N indicating the direction of magnetic field lines. The electromagnets 36 may also be coils with iron cores. The magnetic field is oriented from the front side to the back side of the display device 2A, as indicated by arrow B in FIG. 2. Although not shown, the circuit board 18 includes a signal driver that outputs a signal instructing each electromagnet 36 to operate (apply a magnetic field), an amplifier circuit that amplifies the signal to a magnitude required to operate the electromagnets 36, and the like.

[0036] The magnetic fluid 8 is a liquid in which ferrite-based magnetic particles are appropriately mixed with a surfactant solution, but the magnetic fluid used in the present invention is not limited to this. The non-magnetic fluid 10 is a liquid that does not mix with the oil-based magnetic fluid 8 and separates from it, and water is used here as an example.

[0037] 5 is a partially enlarged view illustrating the mechanism of display using the magnetic fluid 8. When none of the electromagnets 36 is energized, the magnetic fluid 8 settles and accumulates at the bottom end of the glass plate 20 serving as the display surface. This is because the specific gravity of the magnetic fluid 8 is greater than that of the non-magnetic fluid 10 (water), and when the specific gravity of the non-magnetic fluid 10 is greater than that of the magnetic fluid 8, the magnetic fluid 8 accumulates at the top end of the display surface.

[0038] As described above, the accumulation of magnetic fluid 8 is masked by, for example, a yellow-based color coating 32 (see Figure 1 ) to prevent it from being seen from the outside. When the lower electromagnet 36 is energized in this state, its magnetic force draws up magnetic fluid 8 in spots against gravity. By repeatedly de-energizing the first electromagnet 36 and energizing the electromagnet 36 above it, the spots (droplets) of magnetic fluid 8a move upward in a relay-like manner and are held at the target pixel position. At the held position, the surface tension of adjacent magnetic fluid 8a breaks, connecting them to form a line 8b. In reality, the target response characters are formed by tiny dots of magnetic fluid 8 joining or clustering together based on the display data. The color of the spots of magnetic fluid 8a is black, derived from ferrite-based magnetic microparticles, but this is abbreviated by hatching in Figure 5 (as in other figures).

[0039] The movement of the spots of magnetic fluid 8a gives the viewer the impression of swimming tadpoles, which gives interlocutor H a sense of amusement and relaxation. The magnetic fluid 8 does not instantly form a response letter in response to interlocutor H's vocalization (input information). It takes time for the response letter to be formed, and during that time, interlocutor H will enjoy the tadpole-like behavior of the spots of magnetic fluid 8a and wait with interest to see what kind of response letter will be formed. Although letters and figures displayed using magnetic fluid 8 are less appealing than spikes, the novelty of the unique shape of the magnetic fluid 8 can still be fully appreciated. Furthermore, letters formed by a series of spots of magnetic fluid 8a are not as sharp as printed letters, but are three-dimensional and rounded, resulting in a familiar font, as shown in Figure 1.

[0040] The control board 14A is a general-purpose computer equipped with a CPU, ROM, RAM, I / O interface, HDD, etc. As shown in FIG. 6 , the control board 14A includes a voice recognition unit 38 that receives voice data via the microphone 30, a data processing unit 40 that processes the received voice data and generates display data for display on the display 12, and a data output unit 42 that outputs the generated display data to the magnetic force generator 6. The voice recognition unit 38, the data processing unit 40, and the data output unit 42 are implemented by computer programs within the computer. These programs are pre-stored, for example, on a HDD, loaded from the HDD to RAM, and executed by the CPU. The data processing unit 40 extracts a response expression corresponding to the received voice data from an expression pattern table T1 (not shown) and converts it into display data. It also analyzes the tone (high / low) of the received voice data and extracts a corresponding response expression from an expression pattern table T2 (not shown) and converts it into display data. That is, the control board 14 changes the shape of the magnetic fluid 8 based on the data recognized by the voice recognition unit 38. The data processing means 40 can also acquire data as so-called frequency input by determining the frequency of a voice from voice data such as a voice recognized by the voice recognition means 38. Data acquired by such frequency input can more accurately (numerically or quantitatively) determine changes in the physical condition or emotion of the speaker who uttered a voice such as "I'm home," and therefore it becomes possible to reflect more appropriate determinations based on the physical condition or emotion in the output data to the magnetic force generating unit 6.

[0041] FIG. 1 shows a state in which interlocutor H utters "I'm home," and the display device 2A responds by displaying "Welcome back." The utterance "I'm home" is input information from interlocutor H. The response display "Welcome back" is based on the expression pattern extracted from the expression pattern table T1. Furthermore, the CPU checks the tone quality of "I'm home." If the tone quality corresponds to a low tone, the CPU also displays the response "You don't sound well. What's wrong?" This response display is based on the expression pattern extracted from the expression pattern table T2. The expression pattern table T1 pre-stores various response expressions in response to interlocutor H's utterances, and the expression pattern table T2 pre-stores various response expressions corresponding to the tone quality, such as the pitch of interlocutor H's utterances. The CPU appropriately extracts a response expression from either or both of the expression pattern tables T1 and T2 depending on the input voice data. The control board 14A, which functions as a computer, may use deep learning to improve the accuracy of the response expressions (the accuracy of matching between interlocutor H's state and expression patterns).

[0042] As described above, the display device 2A according to this embodiment can respond based on input information (in this case, vocalizations) from the interlocutor H, rather than simply displaying messages based on external input or pre-stored programs, allowing it to be used as a two-way communication tool (interactive product). This contributes to expanding the range of applications. By enabling communication with people using the display device 2A, users can expect benefits similar to those of animal therapy, such as keeping a pet. It is believed that keeping a pet, such as a dog, reduces stress and improves mental health, and medical statistics show a significant difference in mortality rates between people who own pets and those who do not. Furthermore, the display device 2A as a communication tool can be expected to have such healing and psychological counseling effects, and may ultimately be very useful in mental care for people who die alone or commit suicide. Communication has also been shown to have a self-confidence-boosting effect, and the display device 2A with interactive functions, as in this embodiment, may even help support reintegration into society for those who have become socially withdrawn.

[0043] [Second embodiment] A second embodiment will be described with reference to Figures 1, 7, and 8. Parts that are the same as or can be considered the same as those in the first embodiment described above are designated by the same reference numerals, and the structural and functional descriptions already given will be omitted as appropriate (the same applies to the other embodiments described below).

[0044] As shown in FIG. 1 , interlocutor H is wearing a smartwatch 44 as a wearable device on his left hand. As is well known, smartwatches 44 have the function of monitoring biometric information such as heart rate. In this embodiment, the heart rate (biometric information) measured by the smartwatch 44 is used as input information from interlocutor H. As shown in FIG. 7 , display device 2B includes a general receiver 46 using a short-range wireless communication standard for digital devices (e.g., Bluetooth) and receives heart rate data from a smartwatch 44 equipped with a transmitter conforming to the same standard. Control board 14B includes data input means 48 for inputting heart rate data via receiver 46, data processing means 40 for processing the input heart rate data to generate display data, and data output means 42 for outputting the generated display data to magnetic force generator 6. In data processing means 40, a response expression (graphic) corresponding to the input heart rate data is extracted from expression pattern table T3 (not shown) and converted into display data. Also, a response expression corresponding to the input heart rate data is extracted from expression pattern table T4 (not shown) and converted into display data. That is, the display device 2B is equipped with a receiving device 46 that receives biometric information data transmitted from an external device (smart watch 44), and the control board 14B changes the shape of the magnetic fluid 8 based on the data input via the receiving device 46.

[0045] If the heart rate data (heart rate) is within the appropriate range, a crown graphic is displayed together with the word "good!" as shown in Fig. 8. That is, the control board 14B changes the magnetic fluid 8 based on the heart rate data (biometric information) of the interlocutor H to form a response display consisting of graphics and text. Here, the heart rate is used as an example of input information from the interlocutor H side, but blood pressure, electrocardiogram information, etc. may also be used. If the data is within the appropriate range, the interlocutor H will be encouraged by seeing the response display on the display device 2B.

[0046] Third Embodiment A third embodiment will be described with reference to Figures 9 and 10. As shown in Figure 9, the display device 2C in this embodiment includes a non-contact thermometer 50 at the center of the upper end of the frame 26. In this embodiment, the body temperature measured by the non-contact thermometer 50 is used as input information from the interlocutor H. When the interlocutor H turns on the non-contact thermometer 50 by turning on a switch (not shown) and brings the forehead within a predetermined distance, the non-contact thermometer 50 detects infrared rays emitted from the forehead and measures the body temperature (biometric information). If the measured body temperature is within the appropriate range, the control board 14C changes the shape of the magnetic fluid 8 based on the value (body temperature) measured by the non-contact thermometer 50, and displays a response consisting of figures and text similar to those shown in Figure 8.

[0047] [Fourth Embodiment] A fourth embodiment will be described with reference to Figures 11 and 12. As shown in Figure 11, the display device 2D in this embodiment includes a pulse oximeter 52 at the lower right end of the frame 26. In this embodiment, the blood oxygen saturation measured by the pulse oximeter 52 is used as input information from the interlocutor H. Measurement begins when the interlocutor H inserts his or her index finger into the pulse oximeter 52. The control board 14D changes the shape of the magnetic fluid 8 based on the value (blood oxygen saturation) measured by the pulse oximeter 52. If the measured blood oxygen saturation is within the appropriate range, the display device 2D changes the shape of the magnetic fluid 8 based on the measurement value and displays a response display, for example, a cheers symbol and the words "good!" Although not shown, the display device 2D may also include an odor sensor and an alarm. In this case, if the odor sensor detects a gas leak, the alarm may be activated and a warning message such as "Gas Leak" may be displayed.

[0048] Fifth Embodiment A fifth embodiment will be described with reference to FIGS. 13 and 14 . As shown in FIG. 13 , the display device 2E in this embodiment includes a camera 54 with an image sensor such as a CCD or CMOS at the center of the upper end of the frame 26. In this embodiment, facial image data captured by the camera 54 is used as input information from the interlocutor H. The facial image of the interlocutor H captured by the camera 54 is analyzed by an image analysis means 56, which is a computer program pre-stored on a hard disk drive or the like, and the facial expression data is input. The control board 14E changes the shape of the magnetic fluid 8 based on changes in the interlocutor H's facial expression analyzed by the image analysis means 56. The data processing means 40 extracts a response expression corresponding to the input facial expression data from an expression pattern table T5 (not shown) and converts it into display data. In this example, the text "Nice Face!!" is displayed as a response. If the facial expression data is a good pattern, it may be displayed together with a smiling face, for example. The display device 2E may also be configured with a speaker (not shown). After displaying "Nice smell!!", the control board 14E can display, for example, "Listen to this music" and play uplifting music selected from a number of pre-stored songs. In this case, the control board 14E changes the magnetic fluid 8 using an algorithm corresponding to the music. In this way, the display device 2E functions as a visualizer that visualizes sound information, allowing users to further enjoy the unique behavior of the magnetic fluid 8.

[0049] Sixth Embodiment A sixth embodiment will be described with reference to Figures 15 and 16. As shown in Figure 15, a display device 2F in this embodiment includes a microphone 30 for picking up the voice of the interlocutor H, which is provided at the center of the upper end of the display body 12, and a speaker (voice generating unit) 31 that can output voice. Furthermore, the display device 2F in this embodiment does not include the color coat 32 that was provided in the display device 2A in the first embodiment, so that the state of the magnetic fluid 8 that has settled and accumulated at the lower end of the sealed space between the glass plates 20 and 22 (the magnetic fluid 8 to which no magnetic force is applied) can also be visually confirmed.

[0050] 16 , in the display device 2F of this embodiment, the control board 14F includes a voice recognition unit 38 that receives voice data via the microphone 30, a data processing unit 40 that processes the received voice data to generate display data for display on the display unit 12 and response voice data for outputting a response voice from the speaker 31, and a data output unit 42 that outputs the generated display data and response voice data to the magnetic force generator 6 and the speaker 31, respectively. The data processing unit 40 extracts a response corresponding to the voice data received from the voice recognition unit 38 from an expression pattern table T6 (not shown) and generates response voice data. The voice data received from the voice recognition unit 38 is analyzed for tone quality (high and low), and corresponding emotional expressions (specifically, the emotional content of the response) are extracted from an expression pattern table T7 (not shown) and generated as display data. That is, the control board 14 generates a response voice for the interlocutor H based on the data recognized by the voice recognition unit 38, and changes the magnetic fluid 8 to have a shape that reflects the emotional expression toward the interlocutor H. This allows the display device 2F, when spoken to by the interlocutor H, to express emotions by changing the shape and movement of the magnetic fluid 8 along with the replying voice from the speaker 31, allowing the interlocutor H to enjoy the sensation of communicating with a human or pet that has emotions. Below, a specific example will be described of the voice output from the speaker 31 and the changes in the shape and movement of the magnetic fluid 8 due to the application of magnetic force when replying to the interlocutor H using the display device 2F of this embodiment.

[0051] FIG. 17 shows a specific example of the shape change of a magnetic fluid. As shown in the figure, the magnetic fluid 8 can change into the shapes shown by magnetic fluids 8a to 8f in the figure depending on the magnitude (strength) of the magnetic force applied by the electromagnet array 16. Magnetic fluid 8a is in a state where the applied magnetic force is essentially zero. The applied magnetic force gradually increases in the order of magnetic fluids 8b to 8e, with magnetic fluid 8f being in a state where the applied magnetic force is at its maximum. As shown in the figure, when the magnetic force applied to magnetic fluid 8 is zero or relatively small, the magnetic fluid 8 has a rounded shape with almost no spikes, giving an emotionally gentle and calm impression. However, as the applied magnetic force becomes relatively large, the pointed shape of the spikes gradually becomes sharper, and the number of spikes increases and becomes finer, causing the magnetic fluid 8 as a whole to change into a shape that gives an impression of being sharp, emotionally aggressive, and violent. The display device 2F of this embodiment utilizes this shape change characteristic of the magnetic fluid 8 to express emotions when replying from the display device 2F to the interlocutor H. In other words, the shape of magnetic fluid 8a in the figure represents emotions and physical conditions such as a very calm state, a state of low energy, or a state of being very sleepy, while the shape of magnetic fluid 8f represents a state of being very angry or surprised. The shapes of magnetic fluids 8b to 8e represent intermediate emotions and physical conditions in between. Thus, the weaker the magnetic force applied to magnetic fluid 8, the more calm, low energy, or poor physical condition the person feels, while the stronger the magnetic force applied to magnetic fluid 8, the more pronounced emotions such as anger or surprise are.

[0052] 18 to 23 are timing charts showing specific examples of responses from the speaker 31, changes in the magnetic force applied to the magnetic fluid 8, and the resulting changes in the shape of the magnetic fluid. In these timing charts, the horizontal axis represents elapsed time t. The timing chart example shown in FIG. 18 illustrates a case in which a speaker H responds to a message from the display device 2F, such as a message intended to please the other person or to raise high expectations. In this example, the speaker 31 emits sounds (words) simulating a heartbeat, such as "thump," "thump," etc., at regular intervals. At the same time, the magnetic force applied to the magnetic fluid 8 is increased, while the magnetic force is reduced between the sounds. This causes the shape of the magnetic fluid 8 to periodically change in sync with the sounds. This allows the display device 2F to express, both visually and audibly, the emotional excitement of a faster heartbeat. In other words, the interlocutor H can hear the sounds of "thump," "thump," etc. coming from the speaker 31, and can also visually recognize that the magnetic fluid 8 in the display device 2F periodically changes between a rounded shape and a spiky shape with numerous spikes, which allows him or her to have the sensation of communicating with a person who is emotionally excited or upset when communicating with the display device 2F.

[0053] 19 illustrates a timing chart example for expressing a response when interlocutor H makes a surprising remark to display device 2F. In this example, speaker 31 outputs an onomatopoeic word expressing surprise such as "Surprise!" or a sound such as "What?", and at the same time, the magnetic force applied to magnetic fluid 8 is increased to a maximum level and then maintained. This allows the shape of magnetic fluid 8 to change to a shape expressing strong surprise in sync with the sound of "Surprise!" or "What?". Therefore, in the response by display device 2F, it is possible to express, both audibly and visually, the state of being deeply surprised and agitated by what interlocutor H has said to it.

[0054] 20 illustrates an example of a timing chart for a case in which interlocutor H speaks to the display device 2F in a way that angers the other party, and the display device 2F responds accordingly. In this example, the speaker 31 outputs a voice signal indicating anger, such as "Hey!" or "Hey!", and at the same time, the magnetic force applied to the magnetic fluid 8 is increased to a maximum level and then reduced to a medium level. This allows the shape of the magnetic fluid 8 to change to a shape that indicates anger in sync with the voice signal, such as "Hey!" or "Hey!". Therefore, the response by the display device 2F can be expressed both audibly and visually as if the interlocutor H is responding with anger to the words spoken to him.

[0055] 21 is an example of a timing chart showing a case where speaker H says something to the display device 2F that is discouraging to the other person, and a reply is made to that. In this example, the speaker 31 outputs a voice that expresses disappointment, such as "Disappointed...", and at the same time, the magnetic force applied to the magnetic fluid 8, which had been at a moderate level until then, is reduced to substantially zero. This allows the reply by the display device 2F to express, both audibly and visually, the appearance of responding with feelings of disappointment to the content spoken to by the interlocutor H.

[0056] 22, the display device 2F emits a voice message saying "I'm so sleepy..." and at the same time, the magnetic force applied to the magnetic fluid 8, which had been medium until then, is reduced to substantially zero, thereby changing the shape of the magnetic fluid 8 to a rounded shape without spikes. This effectively indicates to the interlocutor H that he is feeling sleepy and has lost his energy, both audibly and visually.

[0057] The timing chart shown in FIG. 23 illustrates a case in which the display device 2F responds to a message from the interlocutor H that is intended to please the other person. In this example, the speaker 31 outputs sounds such as "Yay!" or "So happy!", and the strength of the magnetic force applied to the magnetic fluid 8 is rapidly and gradually changed, making the magnetic fluid 8 appear to dance with joy. This allows the display device 2F to visually and audibly express the joy of responding to the message spoken to by the interlocutor H. Although not shown, the position of the magnetic force applied to the magnetic fluid 8 can be varied vertically or horizontally to create the illusion of the magnetic fluid 8 flying freely around an enclosed space, thereby more accurately expressing the emotion of joy. The aforementioned rapid changes in the strength of the magnetic force and the position of the magnetic force can be simultaneously varied.

[0058] As described above, in the display device 2F of this embodiment, the control unit 14A determines the words to reply to interlocutor H and the emotion to be expressed when replying based on input information from interlocutor H, and based on this determination, controls the speaker 31 to output a reply voice that indicates the emotion toward interlocutor H, and controls the magnetic force generating unit 6 to change the magnetic fluid 8 to a shape that indicates the emotion toward interlocutor H. This allows the display device 2F to change the shape and movement of the magnetic fluid 8 simultaneously with the reply voice from the speaker 31 in accordance with the content of the speech of interlocutor H, thereby enabling pseudo-emotional expression. Furthermore, as a means for indicating an uneasy emotion (strong emotion) such as strong anger, great agitation, or great joy, a relatively strong magnetic force is applied to the magnetic fluid 8, causing the magnetic fluid 8 to have a spiky shape with many spikes. On the other hand, as a means for indicating a calm emotion or a state of low energy, such as a calm mind or a sleepy state, a relatively weak magnetic force is applied to the magnetic fluid 8, causing the magnetic fluid 8 to have a rounded shape with almost no spikes.

[0059] Seventh Embodiment A seventh embodiment will be described with reference to FIGS. 24 and 25 . As shown in FIG. 24 , a display device 2G according to this embodiment includes a microphone 30 at the top center of the display body 12 for picking up the voice of the interlocutor H. Furthermore, in the display device 2G according to this embodiment, the sealed space between the glass plates 20 and 22 is separated into two chambers, an upper chamber 24a and a lower chamber 24b, with a partition wall 27 disposed between them. Each of the upper and lower sealed spaces 24a and 24b contains a magnetic fluid 8 (8A, 8B). In addition, in the display device 2G according to this embodiment, instead of the voice response emitted from the speaker 31 in the sixth embodiment, a response is made in the form of text formed by the magnetic fluid 8A in the upper sealed space 24a. Furthermore, instead of expressing emotions by changing the shape of the magnetic fluid 8 as in the sixth embodiment, a magnetic fluid 8B in the lower sealed space 24b is used. In other words, in the display device 2G of this embodiment, when spoken to by the interlocutor H, the display device 2G responds with letters formed by the magnetic fluid 8A in the upper sealed space 24a, and at the same time expresses emotions by changing the shape and movement of the magnetic fluid 8B in the lower sealed space 24b.

[0060] 25, in the display device 2G of this embodiment, the control board 14G controls the magnetic force applied to the magnetic force generator 6 for the first sealed space 24a based on data recognized by the voice recognition means 38, thereby changing the magnetic fluid 8A to generate letters for replying to the interlocutor H, and controls the magnetic force applied to the magnetic force generator 6 for the second sealed space 24b, thereby changing the magnetic fluid 8B to have a shape that shows an emotional expression toward the interlocutor H. This allows the display device 2F, when spoken to by the interlocutor H, to express emotions by changing the shape and movement of the magnetic fluid 8B as well as the letters formed by the magnetic fluid 8A, so that the interlocutor H can enjoy the sensation of communicating with a human or pet that has emotions, even in this embodiment.

[0061] The present embodiment differs from the sixth embodiment only in that the reply voice from the speaker 31 is replaced by a reply in the form of letters formed by the magnetic fluid 8A in the upper sealed space 24a. Therefore, detailed explanations of the letters formed by the magnetic fluid 8A in the upper sealed space 24a in the reply to the interlocutor H and the changes in shape and movement due to the application of magnetic force to the magnetic fluid 8B in the lower sealed space 24b will be omitted.

[0062] In the sixth and seventh embodiments described above, the microphone 30 picks up the voice produced by the interlocutor H, and a response or emotional expression is made to the voice. However, in addition to this, a response or emotional expression to the interlocutor H may be made based on biometric information of the interlocutor H input using various input means such as a smart watch 44, a non-contact thermometer 50, a pulse oximeter 52, or a camera 54.

[0063] While the above describes embodiments of the present invention, the present invention is not limited to these embodiments and various modifications are possible within the scope of the claims and the technical concepts described in the specification and drawings. For example, in the above embodiments, the magnetic fluid 8 is black. However, as described in Patent Document 1, it may be colored other than black by incorporating soft magnetic light-shielding materials such as glitter. This allows the magnetic fluid 8 to be colored, enabling a variety of color expressions. Furthermore, in the above embodiments, the magnetic fluid 8 is moved by magnetic force to form letters and figures. However, as described in Patent Document 4, the entire space between the glass plates 20 and 22 may be filled with the magnetic fluid 8, and a backlight may be provided on the display 12. Only the portions to which the magnetic field is applied by the electromagnet 36 may be aligned along the direction of the magnetic field, thereby utilizing the light-transmitting property to display letters and figures through transmitted light. Furthermore, a vibrator may be provided on the display 12 to vibrate the display 12 and enhance the display effect of the letters and figures. Furthermore, although individual characteristic features have been described in each of the above embodiments, additional characteristic features may be applied between the respective embodiments.

Claims

1. A display device using a magnetic fluid, comprising: a magnetic force generating unit that generates magnetic force; a display body in which a magnetic fluid and a non-magnetic fluid are sealed; a voice generating unit that emits voice; and a control unit that controls the voice generating unit and the magnetic force generating unit based on input information from a partner, wherein the control unit determines a reply word to the partner and an emotion to be expressed when replying based on the input information from the partner, and based on the determination, controls the voice generating unit to output a reply voice indicating the emotion to the partner, and controls the magnetic force generating unit to change the magnetic fluid to a shape indicating the emotion to the partner, and wherein the control unit and the magnetic force generating unit apply a relatively weak magnetic force to the magnetic fluid when the emotion expressed when replying is mild, compared to when the emotion is strong anger or surprise.

2. A display device using a magnetic fluid, comprising: a magnetic force generating unit that generates magnetic force; a display body in which a magnetic fluid and a non-magnetic fluid are sealed; a voice generating unit that emits voice; and a control unit that controls the voice generating unit and the magnetic force generating unit based on input information from a partner, wherein the control unit determines a reply word to the partner and an emotion to be expressed when replying based on the input information from the partner, and based on the determination, controls the voice generating unit to output a reply voice indicating the emotion to the partner, and controls the magnetic force generating unit to change the magnetic fluid to a shape indicating the emotion to the partner, and the control unit and the magnetic force generating unit apply a relatively stronger magnetic force to the magnetic fluid when the emotion expressed when replying is strong anger or surprise, compared to when the emotion is mild.

3. A display device using a magnetic fluid as described in claim 1, characterized in that the control unit controls the magnetic force generating unit to change the strength of the magnetic force applied to the magnetic fluid while emitting a voice from the voice generating unit, thereby simultaneously generating a response to the interlocutor and expressing an emotion by changing the shape of the magnetic fluid.

4. A display device using a magnetic fluid as described in any one of claims 1 to 3, characterized in that it is provided with a voice input means for inputting the voice of the interlocutor as input information from the interlocutor side, and the control unit determines the words of a reply to the interlocutor and the emotion to be expressed when replying based on the voice input from the voice input means.

5. A display device using a magnetic fluid as described in any one of claims 1 to 3, characterized in that it is provided with a receiving device that receives biometric information data transmitted from an external device as input information from the interlocutor, and the control unit determines the words of a reply to the interlocutor and the emotion to be expressed when replying based on the data input via the receiving device.

6. The display device using a magnetic fluid according to claim 5, characterized in that the bioinformation data is heart rate data transmitted from a wearable device which is the external device.

7. A display device using a magnetic fluid as described in any one of claims 1 to 3, characterized in that it is provided with a non-contact thermometer that measures the body temperature of the interlocutor as input information from the interlocutor, and the control unit determines the words to reply to the interlocutor and the emotion to be expressed when replying based on the value measured by the non-contact thermometer.

8. A display device using a magnetic fluid as described in any one of claims 1 to 3, characterized in that it is provided with a camera capable of taking an image of the interlocutor as input information from the interlocutor, and the control unit has an image analysis means for analyzing changes in the interlocutor's facial expression from the image taken by the camera, and determines the words of a reply to the interlocutor and the emotions to be expressed when replying based on the changes in the interlocutor's facial expression analyzed by the image analysis means.

Images