Information processing device, information processing system, information processing method, program, and recording medium
Patent Information
- Authority / Receiving Office
- EP · EP
- Patent Type
- Applications
- Current Assignee / Owner
- TANABE PHARMA CORP
- Filing Date
- 2024-08-08
- Publication Date
- 2026-06-17
AI Technical Summary
Existing technologies face challenges in quantitatively and objectively detecting signs of neuromuscular diseases at an early stage, particularly in evaluating fine motor functions.
An information processing method that presents a series of tests related to fine motor movement on a user terminal device with a touch panel, generates operation results from these tests, and provides information regarding neuromuscular diseases based on these results. The tests include tracing regions, pinch-out/pinch-in operations, tilt maneuvers, and maze navigation.
This method enables quantitative and objective detection of neuromuscular disease signs at an earlier stage compared to conventional methods, providing detailed information on fine motor function and disease progression.
Smart Images

Figure US2024041391_13022025_PF_FP_ABST
Abstract
Description
[0001] TITLE OF THE INVENTION
[0002] INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING SYSTEM, INFORMATION PROCESSING METHOD, PROGRAM, AND RECORDING MEDIUM
[0003] BACKGROUND OF THE INVENTION
[0004] Field of the Invention
[0005] The present disclosure relates to an information processing device, an information processing system, an information processing method, a program, and a recording medium.
[0006] Description of Background Art
[0007] Japanese Patent No. 6,465,419 describes a motion capture technology. In addition, Intractable Disease Information Center website <URL: https: / / www.nanbyou.or.jp / entry / 5347#01>, The Neurological Society of Japan website <URL: https: / / www.neur0l0gy-jp.0rg / public / disease / index.htrnl#ab0ut>, The Japanese Orthopaedic Association's list of neurological disease symptoms <URL: https: / / www.joa.or.jp / public / sick / body / nerve.html>, and the like can be referenced. The entire contents of these publications are incorporated herein by reference.
[0008] SUMMARY OF THE INVENTION
[0009] According to one aspect of the present invention, an information processing method includes, in a processing part of an information processing device that is connected to a user terminal device via a network: presenting at least one test related to fine motor movement among the following (a) - (h) to the user terminal device; generating an operation result according to an operation with respect to the test on the user terminal device having a touch panel; and generating to-be-provided information regarding a neuromuscular disease based on the operation result that has been acquired:
[0010] (a) a test in which, with respect to a region that forms at least one reference letter presented to the user terminal device, an operation to trace the region on the touch panel is executed, (b) a test in which a pinch-out or pinch-in operation is executed on the touch panel such that a target object on a test image presented to the user terminal device when a display magnification of the test image is at a first reference magnification enters a reference range,
[0011] (c) a test in which a pinch-in operation is executed on the touch panel such that a display magnification of a test image presented to the user terminal device changes from a second reference magnification to a third reference magnification,
[0012] (d) a test in which tap operations are sequentially executed on the touch panel with respect to two or more reference positions presented to the user terminal device,
[0013] (e) a test in which a tap operation on a reference object is executed on the touch panel with respect to two or more different types of moving objects presented to the user terminal device,
[0014] (f) a test in which an operation is executed to tilt the user terminal device such that an object presented to the user terminal device is positioned within a reference range,
[0015] (g) a test in which, in a maze image presented to the user terminal device, an object is moved from a start to a goal within the maze image by tilting the user terminal device, and
[0016] (h) a test in which, regarding a container object and a liquid object in the container object, which are presented to the user terminal device, with respect to the liquid object that flows out from the container object by executing an operation to tilt the user terminal device from a horizontal state, an operation is executed to maintain the horizontal state of the user terminal device within a predetermined test time such that the liquid object is kept in the container object.
[0017] According to another aspect of the present invention, an information processing device is connected to a user terminal device via a network, and executes, in a processing part of the information processing device: presenting at least one of the following tests (a) (h) related to fine motor movement to the user terminal device; generating an operation result according to an operation with respect to the test on the user terminal device having a touch panel; and generating to-be-provided information regarding a neuromuscular disease based on the operation result that has been acquired: (a) a test in which, with respect to a region that forms at least one reference letter presented to the user terminal device, an operation to trace the region on the touch panel is executed,
[0018] (b) a test in which a pinch-out or pinch-in operation is executed on the touch panel such that a target object on a test image presented to the user terminal device when a display magnification of the test image is at a first reference magnification enters a reference range,
[0019] (c) a test in which a pinch-in operation is executed on the touch panel such that a display magnification of a test image presented to the user terminal device changes from a second reference magnification to a third reference magnification,
[0020] (d) a test in which tap operations are sequentially executed on the touch panel with respect to two or more reference positions presented to the user terminal device,
[0021] (e) a test in which a tap operation on a reference object is executed on the touch panel with respect to two or more different types of moving objects presented to the user terminal device,
[0022] (f) a test in which an operation is executed to tilt the user terminal device such that an object presented to the user terminal device is positioned within a reference range,
[0023] (g) a test in which, in a maze image presented to the user terminal device, an object is moved from a start to a goal within the maze image by tilting the user terminal device, and
[0024] (h) a test in which, regarding a container object and a liquid object in the container object, which are presented to the user terminal device, with respect to the liquid object that flows out from the container object by executing an operation to tilt the user terminal device from a horizontal state, an operation is executed to maintain the horizontal state of the user terminal device within a predetermined test time such that the liquid object is kept in the container object.
[0025] Another aspect of the present invention is a program that causes a processing part of an information processing device, which is connected to a user terminal device via a network, to execute: presenting at least one test related to fine motor movement among the following (a) - (h) to the user terminal device; generating the operation result according to an operation with respect to the test on the user terminal device having a touch panel; and generating to-be- provided information regarding a neuromuscular disease based on the operation result that has been acquired:
[0026] (a) a test in which, with respect to a region that forms at least one reference letter presented to the user terminal device, an operation to trace the region on the touch panel is executed,
[0027] (b) a test in which a pinch-out or pinch-in operation is executed on the touch panel such that a target object on a test image presented to the user terminal device when a display magnification of the test image is at a first reference magnification enters a reference range,
[0028] (c) a test in which a pinch-in operation is executed on the touch panel such that a display magnification of a test image presented to the user terminal device changes from a second reference magnification to a third reference magnification,
[0029] (d) a test in which tap operations are sequentially executed on the touch panel with respect to two or more reference positions presented to the user terminal device,
[0030] (e) a test in which a tap operation on a reference object is executed on the touch panel with respect to two or more different types of moving objects presented to the user terminal device,
[0031] (f) a test in which an operation is executed to tilt the user terminal device such that an object presented to the user terminal device is positioned within a reference range,
[0032] (g) a test in which, in a maze image presented to the user terminal device, an object is moved from a start to a goal within the maze image by tilting the user terminal device, and
[0033] (h) a test in which, regarding a container object and a liquid object in the container object, which are presented to the user terminal device, with respect to the liquid object that flows out from the container object by executing an operation to tilt the user terminal device from a horizontal state, an operation is executed to maintain the horizontal state of the user terminal device within a predetermined test time such that the liquid object is kept in the container object. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] A more complete appreciation of the invention and many of the attendant advantages thereof will be readily obtained as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings, wherein:
[0035] Fig. 1 illustrates a structure of an information processing system according to an embodiment of the present invention;
[0036] Fig. 2 illustrates a structure of an information processing device according to an embodiment of the present invention;
[0037] Fig. 3 illustrates a structure of a user terminal device according to an embodiment of the present invention;
[0038] Fig. 4 illustrates a structure of a doctor terminal device according to an embodiment of the present invention;
[0039] Fig. 5 illustrates a tracing movement of a user in a test (a);
[0040] Fig. 6 illustrates reference letters in the test (a);
[0041] Fig. 7 illustrates an operation result of the test (a);
[0042] Fig. 8 illustrates an operation result of the test (a);
[0043] Fig. 9 illustrates zoom-in and zoom-out movements of a user in a test (b);
[0044] Fig. 10 illustrates an operation result of the test (b);
[0045] Fig. 11 illustrates an operation result of the test (b);
[0046] Fig. 12 illustrates reference positions in a test (d);
[0047] Fig. 13 illustrates finger tapping movements of a user in the test (d);
[0048] Fig. 14 illustrates an operation result of the test (d);
[0049] Fig. 15 illustrates an operation result of the test (d);
[0050] Fig. 16 illustrates a moving movement of a user in a test (e);
[0051] Fig. 17 illustrates a moving movement of a user in the test (e); Fig. 18 illustrates an operation result of the test (e);
[0052] Fig. 19 illustrates an operation result of the test (e);
[0053] Fig. 20 illustrates an object and a reference range, as well as a moving movement of a user, in a test (f);
[0054] Fig. 21 illustrates a keeping movement of a user in the test (f);
[0055] Fig. 22 illustrates a maze image and an object in a test (g);
[0056] Fig. 23 illustrates movement of an object in a maze image in the test (g);
[0057] Fig. 24 illustrates an operation result of the test (g);
[0058] Fig. 25 illustrates a container object and a liquid object in a test (h);
[0059] Fig. 26 illustrates an operation result of the test (g);
[0060] Fig. 27 illustrates an operation result of the test (g);
[0061] Fig. 28 is a flowchart illustrating operation of an information processing system according to an embodiment of the present invention;
[0062] Fig. 29 illustrates a hardware structure of each of an information processing device, a user terminal device, and a doctor terminal device according to an embodiment of the present invention;
[0063] Fig. 30 illustrates a software-based hardware structure of each of an information processing device, a user terminal device, and a doctor terminal device according to an embodiment of the present invention;
[0064] Fig. 31 illustrates a user interface of a touch panel of a user terminal device according to an embodiment of the present invention;
[0065] Fig. 32 illustrates a user interface of a touch panel of a user terminal device according to an embodiment of the present invention;
[0066] Fig. 33 illustrates a user interface of a touch panel of a user terminal device according to an embodiment of the present invention;
[0067] Fig. 34 illustrates a user interface of a touch panel of a user terminal device according to an embodiment of the present invention; and Fig. 35 illustrates a user interface of a touch panel of a user terminal device according to an embodiment of the present invention.
[0068] DETAILED DESCRIPTION OF THE EMBODIMENTS
[0069] Embodiments will now be described with reference to the accompanying drawings, wherein like reference numerals designate corresponding or identical elements throughout the various drawings.
[0070] Prior to describing an information processing device, an information processing system, an information processing method, a program and a recording medium according to the present disclosure, a detailed description about “neuromuscular diseases” is provided.
[0071] Examples of “neuromuscular diseases” include Parkinson's disease, Huntington's disease, amyotrophic lateral sclerosis, spinocerebellar degeneration, progressive supranuclear palsy, multiple system atrophy, multiple sclerosis, neuromyelitis optica, adrenoleukodystrophy, metachromatic leukodystrophy, hyperglutaric acidemia type I, phenylketonuria, GM1 gangliosidosis, GM2 gangliosidosis, mucolipidosis type II (I-cell disease), Angelman syndrome, Krabbe disease, Batten disease, mucopolysaccharidosis, Rett's disease, Niemann-Pick disease A, B, C, spinal cord injury, inclusion body myositis, myasthenia gravis, hereditary spastic paraplegia, primary lateral sclerosis, Charcot-Marie-Tooth disease, spinal muscular atrophy, Friedreich's ataxia, dermatomyositis, polymyositis, Guillain-Barre Syndrome, chronic inflammatory, demyelinating polyneuritis, Lambert-Eaton myasthenic syndrome, multifocal motor neuropathy, anti-MAG peripheral neuropathy, facial scapulohumeral muscular dystrophy, muscular dystrophy, myotonic dystrophy, Duchenne muscular dystrophy, facial scapulohumeral muscular dystrophy, spinal and bulbar muscular atrophy, mitochondrial disease, Leigh encephalopathy, MELAS (mitochondrial encephalomyopathy, lactic acidosis, stroke-like seizure syndrome), fragile X-associated tremor / ataxia syndrome (FXTAS), Periceus-Merzbach's disease (PMD), neuritis and myelitis caused by viruses and fungi, cerebral infarction, cervical spondylosis, spondylosis, and the like. Cerebral infarction, cervical spondylosis, and myelopathy are diseases that cause movement disorders, although they are not generally included in neuromuscular diseases, and are synonymously regarded as diseases included in neuromuscular diseases. Structure of Information Processing System
[0072] Fig. 1 illustrates a structure of an information processing system 1 according to an embodiment of the present disclosure.
[0073] As illustrated in Fig. 1, the information processing system 1 includes an information processing device 10, a user terminal device 20, and a doctor terminal device 30. As illustrated in Fig. 1, the information processing device 10, the user terminal device 20, and the doctor terminal device 30 can connect to each other via a network (NW), that is, they can communicate with each other.
[0074] The information processing device 10 is managed by, for example, a medical institution or medical organization (hereinafter referred to as “medical institution or the like”). The information processing device 10 is formed by, for example, a workstation, a general-purpose computer (such as a personal computer), or cloud computing. The information processing device 10 is installed with, for example, an application for communication, or a browser, in order to communicate with the user terminal device 20 and the doctor terminal device 30. The information processing device 10 has a function (for example, as illustrated in Fig. 28) for executing tests (a) - (g). The function of the information processing device 10 is described in detail when the tests (a) - (g) are described.
[0075] The user terminal device 20 is used by a user (US) who wishes to check for signs of muscular diseases. The user terminal device 20 is formed of, for example, a portable communication device (such as a smart phone or a tablet). The user terminal device 20 has, for example, a structure or a function of a touch panel (TP) (for example, as illustrated in Fig. 3) for operation by a user. The user terminal device 20 is installed with, for example, an application for communication, or a browser, in order to communicate with the information processing device 10 and the doctor terminal device 30. The user terminal device 20 has a function (for example, as illustrated in Fig. 28) for executing the tests (a) — (g). The function of the user terminal device 20 is described in detail when the tests (a) - (g) are described.
[0076] The doctor terminal device 30 is used by a doctor (IS) working at a medical institution or the like described above for judging a sign of a neuromuscular disease in the user (US). The doctor terminal device 30 is installed with, for example, an application for communication, or a browser, in order to communicate with the information processing device 10 and the user terminal device 20. The doctor terminal device 30 has a function (for example, as illustrated in Fig. 28) for executing the tests (a) (g). The function of the doctor terminal device 30 is described in detail when the tests (a) - (g) are described.
[0077] A terminal to be notified of to-be-provided information (SJ) (for example, to be described later using Fig. 28) may be the user terminal device 20, the doctor terminal device 30, or a terminal of a third party, for example, a terminal device used by a person providing care for the user (US) or a terminal device used by a medical provider other than the doctor (IS) (for example, a nurse).
[0078] The network (NW) is, for example, the Internet and an intranet. The network (NW) is formed of, for example, a dedicated line network or a public line network, or a wireless communication network or a wired communication network.
[0079] Structure of Information Processing Device
[0080] Fig. 2 illustrates a structure of the information processing device 10 according to an embodiment. As illustrated in Fig. 2, the information processing device 10 has an input part (10A), a processing part (10B), an output part (10C), and a storage part (10D). Regarding functions of the input part (10A), the processing part (10B), the output part (10C), and the storage part (10D), in particular, the function of the processing part (10B), a detailed description will be provided when tests (a) - (h) are described.
[0081] Structure of User Terminal Device
[0082] Fig. 3 illustrates a structure of the user terminal device 20 according to the embodiment. As illustrated in Fig. 3, the user terminal device 20 has an input part (20A), a processing part (20B), an output part (20C), and a storage part (20D). The input part (20A) and the output part (20C) have a touch panel (TP). Specifically, the touch panel (TP) of the input part (20A) and the touch panel (TP) of the output part (20C) are the same. Regarding functions of the input part (20A), the processing part (20B), the output part (20C), and the storage part (20D), in particular, the function of the processing part (20B), a detailed description will be provided when the tests (a) - (h) are described.
[0083] The touch panel (TP) of the user terminal device 20 may be, for example, a so-called aerial display having a function of displaying an aerial image, and a so-called aerial touch panel having a function of accepting a touch operation by the user (US) on the aerial image.
[0084] Structure of Doctor Terminal Device
[0085] Fig. 4 illustrates a structure of the doctor terminal device 30 according to the embodiment. As illustrated in Fig. 3, the doctor terminal device 30 has an input part (30A), a processing part (30B), an output part (30C), and a storage part (30D). Regarding functions of the input part (30A), the processing part (30B), the output part (30C), and the storage part (30D), in particular, the function of the processing part (30B), a detailed description will be provided when the tests (a) - (h) are described.
[0086] Function of Information Processing System
[0087] Basic Function
[0088] As will be described later with reference to Fig. 28, the information processing system 1 includes the following (1) - (4):
[0089] (1) presenting at least one of tests related to fine motor movement of the following (a) — (h) to the user terminal device 20;
[0090] (2) generating an operation result (SK) of the above (1) according to an operation with respect to the test of the above (1) on the user terminal device 20 having the touch panel (TP);
[0091] (3) generating to-be-provided information related to a neuromuscular disease based on the operation result (SK) of the above (2); and
[0092] (4) presenting the to-be -provided information (SJ) of the above (3) to the user terminal device 20.
[0093] The (a) - (h) of the above (1) are as follows. (a) A test (a) in which, with respect to a region (RY1, RY2, RY3) that forms at least one reference letter (KM1, KM2, KM3) (illustrated in Fig. 6) presented to the user terminal device 20, an operation to trace the region (RY1, RY2, RY3) on the touch panel (TP) is executed.
[0094] (b) A test (b) in which a pinch-out or pinch-in operation is executed on the touch panel (TP) such that a target object (MO) (illustrated in Fig. 9) on a test image (SG) (illustrated in Fig. 9) presented to the user terminal device 20 when a display magnification of the test image (SG) is at a first reference magnification (KB1) (not illustrated) enters a reference range (KH) (illustrated in Fig. 9).
[0095] (c) A test (c) in which a pinch-in operation is executed on the touch panel (TP) such that the display magnification of the test image (SG) presented to the user terminal device 20 changes from a second reference magnification (kB2) (not illustrated) to a third reference magnification (KB3) (not illustrated).
[0096] (d) A test (d) in which tap operations are sequentially executed on the touch panel (TP) with respect to two or more reference positions (KPI, KP2) (illustrated in Fig. 12) presented to the user terminal device 20.
[0097] (e) A test (e) in which a tap operation on a reference object (YD) (illustrated in Fig. 16) is executed on the touch panel (TP) with respect to two or more different types of moving objects (YD, WD) (illustrated in Fig. 16) presented to the user terminal device 20.
[0098] (f) A test (f) in which an operation is executed to tilt the user terminal device 20 such that an object (OB) (illustrated in Fig. 20) presented to the user terminal device 20 is positioned within a reference range (KH) (illustrated in Fig. 20).
[0099] (g) A test (g) in which, in a maze image (ME) (illustrated in Fig. 22) presented to the user terminal device 20, an object (OB) is moved from a start to a goal within the maze image (ME) by tilting the user terminal device 20.
[0100] (h) A test (h) in which, regarding a container object (YO) and a liquid object (EO) in the container object (YO), which are presented to the user terminal device 20, with respect to a liquid object (EO) that flows out from the container object (YO) by executing an operation to tilt the user terminal device 20 from a horizontal state, an operation is executed to maintain the horizontal state of the user terminal device 20 within a predetermined test time such that the liquid object (EO) is kept in the container object (YO).
[0101] Tests Using Two Hands
[0102] In the information processing system 1 , an operation result (SK) for each of the tests (a) — (h) is, for example, as illustrated in Fig. 5, an operation result of both an operation using the user's right hand and an operation using the user's left hand.
[0103] Multiple Types of Tests
[0104] In the information processing system 1, within a predetermined period (for example, a period predetermined by the doctor (IS), more specifically, a period determined by the doctor (IS) that is expected for the user (US) to complete, for example, the tests (a, b, c) to be described later), multiple types of tests related to fine motor movement among the tests (a) - (g) (for example, the tests (a, b, c)) are presented to the user terminal device 20, and to-be-provided information (SJ) related to a neuromuscular disease is generated based on the multiple types of tests related to fine motor movement (for example, the above tests (a, b, c)).
[0105] Test (a): Letter Tracing
[0106] Fig. 5 illustrates a tracing movement of the user (US) in the test (a).
[0107] Fig. 6 illustrates the reference letters (KM1, KM2, KM3) in the test (a).
[0108] In the test (a), the user (US) traces, on the touch panel (TP), the region (RY1) (illustrated in Fig. 5) that forms at least one (for example, the reference letter (KM1), illustrated in Fig. 5) of the reference letters (KM1, KM2, KM3) (illustrated in Fig. 6) that are transmitted from the information processing device 10 (the processing part (10B)) and presented to the user terminal device 20.
[0109] More specifically, the user (US) places the user terminal device 20 horizontally on a flat surface (not illustrated). Next, the user (US) traces only one reference letter at a time (for example, only the reference letter (KM2)). More specifically, as illustrated in Figs. 5 and 6, the user (US) starts from a start point (KT) using his / her index finger, traces the reference letter (KM2) while maintaining a tracking line (TL) within the region (RY2) of the reference letter (KM2) toward the end point (ST), and without lifting his / her index finger. Further, the user (US) moves his / her index finger along a direction of an arrow (YJ). As illustrated in Fig. 5, the user (US) performs the test (a) with his / her right hand (MI) and with his / her left hand (HI).
[0110] In the test (a), for example, the reference letters (KM1, KM2) are two or more letters (KM1, KM2) belonging to different types among multiple types classified from the letters (KM1, KM2, KM3) that can be presented by the user terminal device 20. Further, for example, the reference letters (KM1, KM3) are two or more letters (KM1, KM3) belonging to different types among the multiple types classified from the letters (KM1, KM2, KM3) that can be presented by the user terminal device 20. Further, for example, the reference letters (KM1, KM2, KM3) are two or more letters (KM1, KM2, KM3) belonging to different types among the multiple types classified from the letters (KM1, KM2, KM3) that can be presented by the user terminal device 20.
[0111] The above “different types” are as follows. As illustrated in Fig. 6, the reference letter (KM1) is a letter formed only of straight lines. As illustrated in Fig. 6, KM2 is a letter formed only of a curved line. As illustrated in Fig. 6, the reference letter (KM3) is a letter formed of a combination of a straight line and a curved line.
[0112] An operation result (SK) of the test (a) may include an operation result of at least one of the following (a-1) - (a-9):
[0113] (a-1) a total number of times the finger is released from the touch panel (TP),
[0114] (a-2) a total time during which the finger is released from the touch panel (TP),
[0115] (a-3) total times to respectively complete the reference letters (KM1 - KM3),
[0116] (a-4) a total time to complete all of the reference letters (K 1 - KM3),
[0117] (a-5) a total number of pixels traced outside the regions (RY1 - RY3) (pixel is a fundamental unit on the touch panel (TP)),
[0118] (a-6) a ratio of a number of pixels, a time, or a distance of tracing outside the regions (RY1 — RY3) to a total number of pixels, a total time, or a total distance of tracing all the reference letters (KM1 — KM3), (a-7) a farthest distance of tracing outside the regions (RY1 — RY3),
[0119] (a-8) a total distance of tracing each or all of the reference letters (KM1 - KM3), and
[0120] (a-9) an actual line image created by tracing the reference letters (KM1 - KM3).
[0121] Fig. 7 illustrates an operation result (SK) of the test (a) (Part 1).
[0122] Fig. 8 illustrates the operation result (SK) of the test (a) (Part 2).
[0123] In the test (a), as illustrated in Fig. 7, the doctor terminal device 30 displays, for example, a total time (in seconds) to complete all of the reference letters (KM1 - KM3) as described in the above (a-4), for each day on which the test (a) is performed (for example, June 1, June 2, June 3,...). For example, the doctor terminal device 30 displays that it is 10 seconds for the above (a- 4) of the test (a) on June 1.
[0124] In the test (a), for example, when the doctor (IS) clicks on a bar (BO1) for June 1 (illustrated in Fig. 7) displayed on the doctor terminal device 30, the doctor terminal device 30 displays, as illustrated in Fig. 8, the total times that are respectively required to complete the reference letters (KM1 KM3) as described in (a-3) on June 1, that is, it displays that the reference letter (KM1) required 4 seconds, the reference letter (KM2) required 3 seconds, and the reference letter (KM3) required 3 seconds.
[0125] Test (b): Zoom-In And Zoom-Out
[0126] Fig. 9 illustrates zoom-in and zoom-out movements of the user (US) in the test (b).
[0127] In the test (b), as illustrated in Fig. 9, the user (US) performs a pinch-out or pinch-in operation on the touch panel (TP) such that a target object (MO) on a test image (SG) presented to the user terminal device 20 enters a reference range (KH) having a predetermined width when a display magnification of the test image (SG) is at a first reference magnification (KB1) (for example, 200%, 50%).
[0128] More specifically, in zooming in, the user (US) places the user terminal device 20 horizontally on a flat surface (not illustrated). Next, the user (US) zooms in on the target object (MO) by spreading apart the thumb and index finger of his / her right hand (MI) or left hand (HI). The user (US) maintains zooming in until the user terminal device 20 indicates, for example, that “the display magnification has reached the reference range (for example, 200% or more).” The user (US) performs the test (b) with his / her right hand (MI) and with his / her left hand (HI).
[0129] Instead of using the thumb and index finger as described above, for example, it is also possible that the thumb and middle finger are used or the index finger and middle finger are used.
[0130] In the test (b), as illustrated in Fig. 9, the test image (SG) may be, for example, a map image, and the target object (MO) may be a structure (for example, Angkor Wat) located at a predetermined latitude and longitude (for example, 13°N, 103°E) on the map image.
[0131] An operation result (SK) of the test (b) may include an operation result of at least one of the following (b-1) and (b-2):
[0132] (b-1) a total number of pinch-out or pinch-in movements performed until the first reference magnification (KB1) is reached, and
[0133] (b-2) a total time until the first reference magnification (KB1) is reached and the target object (MO) enters the reference range (KH).
[0134] Fig. 10 illustrates an operation result (SK) of the test (b) (Part 1).
[0135] Fig. 11 illustrates the operation result (SK) of the test (b) (Part 2).
[0136] In the test (b), as illustrated in Fig. 10, the doctor terminal device 30 displays, for example, a total time (in seconds) until the first reference magnification (KB1) is reached and the target object (MO) enters the reference range (KH), as described in the above (b-2), for each day on which the test (b) is performed (for example, June 1, June 2, June 3,...). The doctor terminal device 30 displays, for example, a zoom-in time (ZI) (in seconds) and a zoom-out time (ZO) (in seconds) for the test (b) on June 1.
[0137] In the test (b), for example, when the doctor (IS) clicks on a bar (BO1) (IN) for June 1 displayed on the doctor terminal device 30, the doctor terminal device 30 displays that, as illustrated in Fig. 11 , a total zoom-in time (ZI) (in seconds), which is one of total times (in seconds) as described in (b-2) until the first reference magnification (KB1) is reached and the target object (MO) enters the reference range (KH) on June 1, is 1.8 seconds. In the test (c), the user (US) executes a pinch-in operation on the touch panel (TP) such that a display magnification of a test image (SG) (for example, illustrated in Fig. 9) presented to the user terminal device 20 changes from a second reference magnification (KB2) (for example, 200%) to a third reference magnification (KB3) (for example, 50%), that is, such that the display magnification is reduced.
[0138] In the test (c), the test image (SG) may be a map image (for example, as illustrated in Fig. 9).
[0139] An operation result (SK) of the test (c) may include an operation result of at least one of the following (c-1) and (c-2):
[0140] (c-1) a total number of pinch-in operations performed until the third reference magnification (KB3) is reached, and
[0141] (c-2) a total time until the third reference magnification (KB3) is reached.
[0142] In a case where both the test (b) and the test (c) are performed, the first reference magnification (KB1) and the second reference magnification (KB2) may be the same, and the test (c) may be executed after executing the test (b).
[0143] In the test (b), a user may be asked only to perform a task using his / her dominant hand, depending on the results of data analyses and / or using only one combination of fingers, for example, index and middle fingers. Also, a gamified feature may be added to this test, where a user will be asked to identify a visible detail such as a street address and house color, once he / she has "virtually arrived" the target destination (e.g., Eifel tower) located at a predetermined latitude and longitude (e.g., 13°N, I03°E) on the map image.
[0144] Test (d): Finger Tapping
[0145] Fig. 12 illustrates reference positions (KPI, KP2) in the test (d).
[0146] Fig. 13 illustrates finger tapping movements of the user (US) in the test (d).
[0147] In the test (d), as illustrated in Fig. 13, the user (US) sequentially executes tap operations on the touch panel (TP) with respect to two or more reference positions (KPI, KP2,...) (illustrated in Fig. 12) presented to the user terminal device 20. More specifically, in the test (d), the user (US) places the user terminal device 20 horizontally on a flat surface (not illustrated). Next, while resting his / her wrist on the flat surface, the user (US) uses the index and middle fingers of his / her right hand (MI) or left hand (HI) to tap the reference positions (KPI, KP2) alternately as quickly as possible. For example, the user (US) attempts to tap the reference positions (KPI, KP2) as accurately as possible for 15 seconds.
[0148] An operation result (SK) of the test (d) may include an operation result of at least one of the following (d-1 ) - (d-7):
[0149] (d-1) a total number of taps on the touch panel (TP),
[0150] (d-2) a total number of taps with the right hand on the touch panel (TP),
[0151] (d-3) a total number of taps with the left hand on the touch panel (TP),
[0152] (d-4) a total number of taps with respect to the reference positions (KPI, KP2,...) on the touch panel (TP),
[0153] (d-5) an average speed of taps on the touch panel (TP),
[0154] (d-6) a time interval between each tap or an average time interval between all taps on the touch panel (TP),
[0155] (d-7) coordinates of each tap, and
[0156] (d-8) an average deviation of tap coordinates from the reference positions (KPI, KP2,...).
[0157] Fig. 14 illustrates an operation result of the test (d) (Part 1).
[0158] Fig. 15 illustrates the operation result of the test (d) (Part 2).
[0159] In the test (d), as illustrated in Fig. 14, the doctor terminal device 30 displays, for example, for the test (d) performed with the right hand (MI) of the user (US), a total number of taps (number of times) with respect to the reference positions (KPI, KP2,...) on the touch panel (TP) as described in (d-4) above, for each day on which the test (d) is performed (for example, June 1, June 2, June 3...). The doctor terminal device 30 displays, for example, that it is 215 times for the above (d-4) on June 1. In the test (d), for example, when the doctor (IS) clicks on a bar (BO1) for June 1 (illustrated in Fig. 14) displayed on the doctor terminal device 30, the doctor terminal device 30 displays, as illustrated in Fig. 15, that on June 1, 2023, the number of successful taps (SET) was 200 times, the number of failed taps (SIT) was 8 times, and the number of alternating erroneous taps (KOT) was 7 times.
[0160] A “successful tapping (SET)” refers to that, among the reference positions (KPI, KP2,...), when the reference position to be tapped is, for example, the reference position (KPI), the user (US) successfully taps the reference position (KPI).
[0161] A “failed tapping (SIT)” refers to that, among the reference positions (KPI, KP2,...), when the reference position to be tapped is, for example, the reference position (KPI), the user (US) fails to tap the reference position (KPI).
[0162] An “alternating erroneous tapping (KOT)” refers to that, among the reference positions (KPI, KP2,...), when the reference position to be tapped is, for example, the reference position (KPI), the user (US) taps the reference position (KP2) without tapping the reference position (KPI).
[0163] In the above explanation, the test is performed with both hands once each. However, the test may be performed only with either hand. In addition, at least two tests may be performed for each hand, and the mean value of each test may be used for evaluation.
[0164] Test (e): Moving Dots
[0165] Fig. 16 illustrates a moving movement of the user (US) in the test (e) (Part 1).
[0166] Fig. 17 illustrates a moving movement of the user (US) in the test (e) (Part 2).
[0167] In the test (e), as illustrated in Fig. 16, the user (US) executes a tap operation on the touch panel (TP) on a good dot (YD), which is a reference object, with respect to two or more different types of moving objects, that is, good dots (YD) and bad dots (WD) (illustrated in Fig. 17), presented to the user terminal device 20. More specifically, the user (US) places the user terminal device 20 horizontally on a flat surface (not illustrated). The user (US) uses his / her index finger to tap a moving good dot (YD). When a good dot (YD) is tapped, the user terminal device 20 displays a butterfly (CY) as illustrated in Fig. 17 (right diagram). When the user (US) taps a certain good dot (YD), the user terminal device 20 displays another good dot (YD). The user (US) attempts to tap as many good dots (YD) as possible, for example, for 30 seconds.
[0168] In contrast to the above, when the user (US) taps a moving bad dot (WD), the user terminal device 20 displays an “x” mark indicating that the tapping is incorrect, as illustrated in Fig. 17 (left diagram).
[0169] In the test (e), the different types of moving objects, that is, the good dots (YD) and the bad dots (WD), may be moving objects that are different from each other in at least one of color and shape.
[0170] An operation result (SK) of the test (e) may include an operation result of at least one of the following (e-1) - (e-4):
[0171] (e-1) a total number of taps on the good dots (YD), which are reference objects,
[0172] (e-2) a total number of taps on the bad dots (WD), which are objects other than the good dots (YD), which are reference objects,
[0173] (e-3) a total number of taps on the touch panel (TP),
[0174] (e-4) a total number of taps on regions other than the good dots (YD) and the bad dots (WD), which are objects,
[0175] (e-5) a distance from a center position of a good dots (YD), which is a reference object, and
[0176] (e-6) a total time until completion of a predetermined number of taps.
[0177] Fig. 18 illustrates an operation result (SK) of the test (e) (Part 1).
[0178] Fig. 19 illustrates the operation result (SK) of the test (e) (Part 2).
[0179] In the test (e), as illustrated in Fig. 18, the doctor terminal device 30 displays, for example, the total numbers of taps (numbers of times) of the above (e-1), (e-2), and (e-4), for each day on which the test (e) is performed (for example, June 1, June 2, June 3...). The doctor terminal device 30 displays, for example, that the total numbers of taps of the above (e-1), (e-2), and (e-4) of the test (e) on June 1 are respectively 30, 15, and 10.
[0180] In Fig. 18, “on-target tapping (ONT)” corresponds to the above (e-1), “off-target tapping (OFT)” corresponds to the above (e-2), and “error tapping (ERT)” corresponds to the above (e- 4).
[0181] In the test (e), for example, when the doctor (IS) clicks on a bar (BO1) for June 1 (illustrated in Fig. 18) displayed on the doctor terminal device 30, the doctor terminal device 30 displays, as illustrated in Fig. 19, that on June 1, 2023, the “on-target tapping (ONT)” was 30 times, the error tapping (ERT) was 10 times, and the “off-target tapping (OFT)” was 15 times.
[0182] Test (f): Keeping Level
[0183] Fig. 20 illustrates an object (OB) and a reference range (KH), as well as a moving movement of the user (US), in the test (f).
[0184] Fig. 21 illustrates a keeping movement of the user (US) in the test (f).
[0185] In the test (f), as indicated by an arrow in Fig. 20, the user (US) executes an operation to tilt the user terminal device 20 such that an object (OB) (for example, ball-shaped) presented to the user terminal device 20 is positioned within the reference range (KH).
[0186] More specifically, for example, the user (US) holds the user terminal device 20 parallel to a ground surface with his / her right hand (MI). As indicated by an arrow (YJ) in Fig. 20, the user (US) attempts to move a ball-shaped object (OB) from a position near a circumference of a circle (EN) to a reference range (KH), which is a region having a predetermined width including a center of the circle (EN). After that, as illustrated in Fig. 21, the user (US) continues to maintain the object (OB) at a position within the reference range (KH), more specifically, until the user terminal device 20 indicates, for example, by a beep, that a required holding time has ended.
[0187] An operation result (SK) of the test (f) may include an operation result of at least one of the following (f-1) - (f-4):
[0188] (f-1) a total time the object (OB) is positioned within the reference range (KH),
[0189] (f-2) a total time the object (OB) is positioned outside the reference range (KH), (f-3) a total number of times the object (OB) is positioned within the reference range
[0190] (KH),
[0191] (f-4) aposition of the object (OB) in each predetermined period, and
[0192] (f-5) an image of an actual trajectory along which the object (OB) has moved.
[0193] Test (g): Maze
[0194] Fig. 22 illustrates a maze image (ME) and an object (OB) in the test (g).
[0195] Fig. 23 illustrates movement of the object (OB) in the maze image (ME) in the test (g).
[0196] In the test (g), as illustrated in Figs. 22 and 23, the user (US) moves the object (OB), for example, a marble-ball-shaped object, from a start (ST) to a goal (GO) within the maze image (ME) presented to the user terminal device 20 by tilting the user terminal device 20.
[0197] More specifically, for example, the user (US) uses a strap of a mobile device, which is the user terminal device 20, to hold the user terminal device 20 in a horizontal position with one hand. The user (US) tilts the user terminal device 20 so as to keep the user terminal device 20 as horizontal to a ground surface as possible and to guide the object (OB) to escape from the maze shown in the maze image (ME). The user (US) finishes the escape from the maze shown in the maze image (ME) within a predetermined time (for example, 45 seconds).
[0198] In the test (g), the user terminal device 20 may additionally display a guide line (DO) (illustrated in Fig. 23) from the start (ST) to the goal (GO) on the maze image (ME), only during an initial test.
[0199] In the test (g), within a predetermined period (for example, 45 seconds described above), the user terminal device 20 may present the same maze image (ME) multiple times at different rotation angles (angles rotated about a virtual rotation axis passing through the start (ST)).
[0200] An operation result (SK) of the test (g) may include an operation result of at least one of the following (g-1 ) — (g-6):
[0201] (g-1) a result indicating success or failure with respect to the maze image (ME),
[0202] (g-2) a total time from the start (ST) to the goal (GO), (g-3) a total deviation distance from an ideal path,
[0203] (g-4) a maximum deviation from the ideal path,
[0204] (g-5) finger position coordinates in each predetermined period, and
[0205] (g-6) an image of an actual trajectory along which the object (OB) has moved with respect to the maze image (ME).
[0206] Fig. 24 illustrates an operation result (SK) of the test (g).
[0207] In the test (g), as illustrated in Fig. 24, the doctor terminal device 30 displays, for example, as a result indicating success or failure with respect to the maze image (ME) as described in the above (g-1), a successful escape (DSE) or a failed escape (DSI), and in the case of a successful escape (DSE), a required time (in seconds), for each day on which the test (g) is performed (for example, June 1, June 2, June 3...). For example, the doctor terminal device 30 displays that, for the above (g-1) of the test (g) on June 1, it is a successful escape (DSE), and the required time is 21 seconds. On the other hand, the doctor terminal device 30 displays, for example, that, for the above (g-1) of the test (g) on June 3, it is a failed escape (DSI), and displays a time of 45 seconds, which is the above predetermined period.
[0208] In the test (g), it is desirable to avoid that the user (US) memorizes a route for escaping from the maze shown in the maze image (ME) (for example, illustrated in Fig. 22). More specifically, it is desirable to avoid a situation where the user (US) increasingly accurately memorizes a route from the start (ST) to the goal (GO) in the maze image (ME) by repeatedly performing the test (g) based on the same maze image (ME), and as a result, the required time from the start (ST) to the goal (GO) gradually becomes shorter. In order to avoid the situation described above, it is desirable that the user terminal device 20 displays multiple maze images (ME) that differ from each other and have a uniform degree of difficulty.
[0209] Examples of multiple maze images (ME) that differ from each other and have a uniform degree of difficulty include: (1) a maze image that has the same structure (same route) as the maze image (ME) and is obtained by rotating the maze image (ME) a predetermined angle (for example, 30 degrees, or 45 degrees) around a virtual straight line passing through the start (ST), (2) a maze image obtained by vertically flipping the maze image (ME), and (3) a maze image obtained by horizontally flipping the maze image (ME). Preferably, the maze provided to the subject is changed periodically. For example, it is preferable to change the maze every month. In this case, from the 7th month onwards, the maze used from the 1 st month to the 6th month may be provided again.
[0210] Test (h): Serving Coffee
[0211] Fig. 25 illustrates a container object (YO) and a liquid object (EO) in the test (h).
[0212] In the test (h), as illustrated in Fig. 25, regarding a container object (YO) and a liquid object (EO) in the container object (YO), which are presented to the user terminal device 20, the user (US) executes an operation to tilt the user terminal device 20 from a horizontal state. The user (US) executes an operation to maintain the horizontal state of the user terminal device 20 within a predetermined test time so as to keep the liquid object (EO), which is about to flow out of the container object (YO) due to the tilting operation, in the container object (YO).
[0213] More specifically, the user (US) uses a strap of a mobile device, which is the user terminal device 20, to hold a coffee cup, which is the container object (YO), for example, for 15 seconds, such that coffee, which is the liquid object (EO), does not flow out from the coffee cup.
[0214] An operation result (SK) of the test (h) may include an operation result of at least one of the following (h-1 ) — (h-6):
[0215] (g-1) a total number of times the liquid object (EO) flows out from the container object (YO),
[0216] (g-2) a maximum tilt angle of the user terminal device 20 when the liquid object (EO) flows out from the container object (YO),
[0217] (g-3) an average tilt angle of the user terminal device 20 when the liquid object (EO) flows out from the container object (YO),
[0218] (g-4) position coordinates of the user terminal device 20 during the test (h),
[0219] (g-5) a position where the liquid object (EO) flows out from the container object (YO),
[0220] (g-6) a ratio of time the liquid object (EO) flows out from the container object (YO) to the test time, (g-7) a ratio of time the liquid object (EO) does not flow out from the container object (YO) to the test time,
[0221] (g-8) a total time the liquid object (EO) flows out from the container object (YO), and
[0222] (g-9) A total time the liquid object (EO) does not flow out from the container object (YO).
[0223] Fig. 26 illustrates an operation result (SK) of the test (g) (Part 1).
[0224] Fig. 27 illustrates the operation result (SK) of the test (g) (Part 2).
[0225] In the test (g), as illustrated in Fig. 26, the doctor terminal device 30 displays, for example, as the total number of times (number of times) the liquid object (EO) flows out from the container object (YO) as described in the above (g-1), a flow-out count (RK) (number of times), for each day on which the test (g) is performed (for example, June 1, June 2, June 3...). The doctor terminal device 30 displays, for example, that for the above (g-1) of the test (g) on June 1, the flow-out count is 10.
[0226] In the test (g), further, as illustrated in Fig. 27, the doctor terminal device 30 displays, for example, as the total time (in seconds) the liquid object (EO) flows out from the container object (YO) as described in the above (g-8), and as the total time (in seconds) the liquid object (EO) does not flow out from the container object (YO) as described in the above (g-9), a flow-out time (RJ) (in seconds) and a no-flow-out time (RNJ) (in seconds), for each day on which the test (g) is performed (for example, June 1, June 2, June 3...). The doctor terminal device 30 displays, for example, that as the above (g-8) and (g-9) of the test (g) on June 1, the flow-out time (RJ) (in seconds) and the no-flow-out time (RNJ) (in seconds) are 14 seconds and 86 seconds, respectively.
[0227] Fig. 28 is a flowchart illustrating operation of the information processing system 1 of the embodiment.
[0228] Operation of the information processing system 1 is described with reference to the flowchart of Fig. 28.
[0229] STI : The user (US) uses the user terminal device 20 to transmit, via the network (NW), a request for execution of at least one of the above-described tests related to fine motor movement (the above-described tests (a) — (h)), for example, a request for execution of the test (a), to the information processing device 10 (the input part (10A) and the processing part (10B)).
[0230] ST2: Upon receiving the request for execution of the test (a) from the user terminal device 20, the information processing device 10 (the processing part (10B), and the output part (10C)) presents the test (a) to the user terminal device 20.
[0231] ST3: when the user (US) performs an operation in response to the presentation of the test (a) from the information processing device 10, the user terminal device 20 receives the operation.
[0232] ST4: Upon receiving the operation of the test (a) from the user (US), the user terminal device 20 transmits the operation to the information processing device 10 (the input part (10A), and the processing part (10B)).
[0233] ST5: Upon receiving the operation of the test (a), the information processing device 10 (the processing part (10B)) generates an operation result (SK), which is a result of the operation.
[0234] ST6: When the operation result (SK) of the test (a) is generated, the information processing device 10 (the processing part (B), and the output part (10C)) transmits the operation result (SK) of the test (a) to the user terminal device 20 and the doctor terminal device 30.
[0235] ST7: Upon receiving the operation result (SK) of the test (a) from the information processing device 10 (the output part (10C)), the user terminal device 20 and the doctor terminal device 30 each display the operation result (SK) of the test (a).
[0236] ST8: When the operation result (SK) of the test (a) is generated, the information processing device 10 (processing part (10B)) further generates to-be-provided information (SJ) related to a neuromuscular disease based on the operation result (SK).
[0237] Specifically, when the operation result (SK) of the test (a) is generated, the information processing device 10 (the processing part (10B)) analyzes the operation result (SK) and detects a subtle sign of a neuromuscular disease from a result of the analysis. More specifically, the information processing device 10 (the processing part (10B)) detects, for example, a current value of a fine motor function in a neuromuscular disease, or a value of a chronological change, from the operation result (SK), and infers a sign of an abnormality in the fine motor function predicted using Al or the like. The information processing device 10 (the processing part (10B)) generates to-be-provided information (SJ) related to a neuromuscular disease based on the sign. ST9: When the to-be-provided information (SJ) of the test (a) is generated, the information processing device 10 (the processing part (10B), and the output part (IOC)) transmits the to-be-provided information (SJ) of the test (a) to the user terminal device 20 and the doctor terminal device 30.
[0238] ST10: Upon receiving the to-be-provided information (SJ) of the test (a) from the information processing device 10 (the output part (IOC)), the user terminal device 20 and the doctor terminal device 30 each display the to-be-provided information (SJ) of the test (a).
[0239] Here, the to-be-provided information (SJ) is, for example, the following (SJ1) — (SJ4):
[0240] For example, the to-be-provided information (SJ) of (SJ1) and (SJ2) corresponds to the operation results (SK) illustrated in Figs. 7 — 9 and the like.
[0241] (SJ1) A current state of a fine motor function of the user (US) based on an operation result (SK) of the tests (a) (h).
[0242] (SJ2) A change in a fine motor function of the user (US) based on an operation result (SK) of the tests (a) - (h).
[0243] (SJ3) An action of the user (US) recommended to the user (US) and the doctor (IS) or the like based on the test information (SJ) of the above (SJ1) and (SJ2).
[0244] (SJ4) An action of the user (US) recommended to the user (US) and the doctor (IS) based on a prediction of progression of a neuromuscular disease calculated using an algorithm for predicting progression of a neuromuscular disease, from an operation result (SK) of the tests (a) - (h).
[0245] Instead of or in addition to a numerical value of an operation result (SK) (for example, a current value, or a value changing over time), the to-be-provided information (SJ) of (SJ1) and (SJ2) may include a statement such as “The fine motor function of the user (US) is equivalent to the average fine motor function of healthy people for the period from O month > day to A month V day.” More specifically, after comparing the fine motor function of the user (US) with the fine motor function of healthy people, qualitative information on whether the fine motor function of the user (US) exceeds, falls below, or belongs to one of several ranks (for example, far exceeds, slightly exceeds, substantially equivalent, slightly lower, far lower) compared to the fine motor function of healthy people may be included. The test information SJ of (SJ1) and (SJ2), in particular, the above-described qualitative information, can help the user (US) and the doctor (IS) or the like in considering a future action.
[0246] The to-be-provided information (SJ) of (SJ3) may include, for example, advice to be recommended based on a value indicated by the to-be-provided information (SJ) of (SJ1) and (SJ2). More specifically, it may include advising the user (US) that it is desirable to have a visit by a specialist doctor, and introducing matters that can assist the user (US) in daily activities (for example, recommending devising movements, using convenient tools, and remodeling housing, regarding meals, changing clothes, bathing, excretion, and the like).
[0247] The to-be-provided information (SJ) of (SJ4) may include, for example, advising the user (US) to have a visit by a specialist doctor, advice on actions that may be necessary in the future (for example, introduction of a wheelchair that does not require manual operation), and introducing matters (same as above) that can assist the user (US) in future daily activities.
[0248] Hardware Structure
[0249] Fig. 29 illustrates a hardware structure of each of the information processing device 10, the user terminal device 20, and the doctor terminal device 30 according to the embodiment.
[0250] As illustrated in Fig. 29, the information processing device 10, the user terminal device 20, and the doctor terminal device 30 of the embodiment each include, in order to fulfill their respective functions, a processing circuit (SH), and further each include an input circuit (NY) and an output circuit (SY) when necessary.
[0251] The processing circuit (SH) is a dedicated piece of hardware. The processing circuit (SH) mainly realizes the function of the processing part (10B), the processing part (20B), and the processing part (30B) (illustrated in Figs. 2 4) of the information processing device 10, the user terminal device 20, and the doctor terminal device 30.
[0252] The processing circuit (SH) is, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a combination thereof. The input circuits (NY) and the output circuits (SY) exchange inputs and outputs related to operations of the processing circuits (SH) between the information processing device 10, the user terminal device 20, and the doctor terminal device 30, and external devices.
[0253] Software-Based Hardware Structure
[0254] Fig. 30 illustrates a software-based hardware structure of each of the information processing device 10, the user terminal device 20, and the doctor terminal device 30.
[0255] As illustrated in Fig. 30, the information processing device 10, the user terminal device 20, and the doctor terminal device 30 each include, in order to fulfill their respective functions, a processor (PR) and a storage circuit (KI), and further each include an input circuit (NY) and an output circuit (SY) when necessary.
[0256] The processor (PR) is a CPU (central processing unit, processing unit, arithmetic unit, microprocessor, microcomputer, DSP (digital signal processor)) that executes a program. The processor (PR) mainly realizes the function of the processing part (10B), the processing part (20B), and the processing part (30B) (illustrated in Figs. 2 - 4) of the information processing device 10, the user terminal device 20, or the doctor terminal device 30.
[0257] The processor (PR) performs realization of the above function using software, firmware, or a combination of software and firmware. Software and firmware are described as a program (PRG), which is stored in the storage circuit (KI).
[0258] The processor (PR) realizes the above function by reading out and executing the program (PRG) from the storage circuit (KI). In other words, the above program (PRG) causes a computer to execute procedures and methods of each part of the information processing device 10, the user terminal device 20, and the doctor terminal device 30.
[0259] Here, the storage circuit (KI) is, for example, a nonvolatile or volatile semiconductor memory such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), as well as a magnetic disk, a flexible disk, an optical disk, a compact disc, a mini disc, a DVD (Digital Versatile Disc), or the like. Among the functions of the information processing device 10, the user terminal device 20, and the doctor terminal device 30, some functions may be realized by the processing circuit (SH) (illustrated in Fig. 29), and other functions may be realized by the processor (PR) (illustrated in Fig. 30).
[0260] As described above, the functions of the information processing device 10, the user terminal device 20, and the doctor terminal device 30 can be realized by hardware, software, firmware, or a combination thereof.
[0261] The input circuits (NY) and the output circuits (SY) exchange inputs and outputs related to operations of the processor (PR) between the information processing device 10, the user terminal device 20, and the doctor terminal device 30, and external devices.
[0262] User Interface Of Touch Panel Of User Terminal Device
[0263] Figs. 31 — 35 illustrate a user interface of the touch panel (TP) of the user terminal device 20.
[0264] The user interface illustrated in Figs. 31 — 35 is displayed to the user (US) on the touch panel (TP) of the user terminal device 20 prior to starting the above-described tests (a) - (h).
[0265] In the user interface (illustrated in Fig. 31), as illustrated in Fig. 31 , under a title “HOW IT WORKS,” for example, an “explanatory diagram” and an “explanatory text” explaining the test (a) (letter tracing) are displayed, and a “Get Started” button is displayed in a bottom row.
[0266] An example of the “explanatory text” is as follows:
[0267] Put your phone on a flat surface. Click on the begin button to start the test. The test will contain a 3 letter word, each letter to be traced one at a time. Trace each letter as accurately as you can. Try not to lift your finger while performing the test. Start tracing from the green point specified within the letter and finish the trace at the red point. Please follow the arrows to ensure the letter is being traced in the right direction. Once you successfully completed tracing a letter, click on the next button to proceed to the next letter.
[0268] In the user interface (illustrated in Fig. 32), as illustrated in Fig. 32, on the left side, under a title “HOW IT WORKS,” for example, an “explanatory diagram” and an “explanatory text” explaining performing the test (a) (letter tracing) with the left hand are displayed, and a “Get Started” button is displayed in a bottom row. On the other hand, on the right side, under a title “HOW IT WORKS,” for example, an “explanatory diagram” and an “explanatory text” explaining performing the test (a) (letter tracing) with the right hand are displayed, and a “Get Started” button is displayed in a bottom row.
[0269] An example of the “explanatory texts” is as follows:
[0270] Left Hand
[0271] Tap the circles using your Left Hand.
[0272] Put your phone on a flat surface. Use your index and middle fingers of your left hand toll alternately tap the circles on the screen.
[0273] Tap inside the circle for accuracy.
[0274] Try to time your taps as evenly as possible within the given time of 30 seconds.
[0275] Right Hand
[0276] Tap the circles using your Right Hand.
[0277] Put your phone on a flat surface. Use your index and middle fingers of your right hand toll alternately tap the circles on the screen.
[0278] Tap inside the circle for accuracy.
[0279] Try to time your taps as evenly as possible within the given time of 30 seconds.
[0280] In the user interface (illustrated in Fig. 33), as illustrated in Fig. 33, the display is largely divided into left and right halves. More specifically, on the left side in the left half, under a title “HOW IT WORKS,” for example, an “explanatory diagram” and an “explanatory text” explaining performing the test (a) (letter tracing) with the left hand are displayed, and a “Let's practice it first” button is displayed in a bottom row. Similarly, on the right side in the left half, under a title “HOW IT WORKS,” for example, an “explanatory diagram” and an “explanatory text” explaining performing the test (a) (letter tracing) with the right hand are displayed, and a “Let's practice it first” button is displayed in a bottom row.
[0281] An example of the “explanatory texts” is as follows:
[0282] Left Half
[0283] Left Hand
[0284] Tap the circles using your Left Hand.
[0285] Put your phone on a flat surface. Use your index and middle fingers of your left hand to alternately tap the circles on the screen.
[0286] Tap inside the circle for accuracy.
[0287] Try to time your taps as evenly as possible within the given time of 30 seconds.
[0288] Right Hand
[0289] Tap the circles using your Right Hand.
[0290] Put your phone on a flat surface. Use your index and middle fingers of your right hand to alternately tap the circles on the screen.
[0291] Tap inside the circle for accuracy.
[0292] Try to time your taps as evenly as possible within the given time of 30 seconds.
[0293] Right Half
[0294] Left Hand
[0295] Tap the circles using your Left Hand.
[0296] Put your phone on a flat surface. Use your index and middle fingers of your left hand to alternately tap the circles on the screen. Tap inside the circle for accuracy.
[0297] Try to time your taps as evenly as possible within the given time of 30 seconds.
[0298] Right Hand
[0299] Tap the circles using your Right Hand. Put your phone on a flat surface. Use your index and middle fingers of your right hand to alternately tap the circles on the screen. Tap inside the circle for accuracy.
[0300] Try to time your taps as evenly as possible within the given time of 30 seconds.
[0301] On the other hand, on the left side of the right half, similarly to the left side of the left half, under a title “HOW IT WORKS,” for example, an “explanatory diagram” and an “explanatory text” explaining performing the test (a) (letter tracing) with the left hand are displayed, and differently from the left side of the left half, a “Now for the real test” button is displayed in a bottom row. Further, on the right side of the right half, similarly to the right side of the left half, under a title “HOW IT WORKS,” for example, an “explanatory diagram” and an “explanatory text” explaining performing the test (a) (letter tracing) with the right hand are displayed, and differently from the right side of the left half, a “Now for the real test” button is displayed in a bottom row.
[0302] In the user interface (illustrated in Fig. 34), as illustrated in Fig. 34, under a test name “Letter Tracing” (meaning the test (a)), an “explanatory diagram” and an “explanatory text” explaining letter tracing are displayed so as to sandwich a title “HOW IT WORKS,” and a “Get Started” button is displayed in a bottom row.
[0303] An example of the “explanatory text” is as follows:
[0304] Put your phone on a flat surface. Click on the begin button to start the test.
[0305] The test will contain a 3 letter word, each letter to be traced one at a time.
[0306] Trace each letter as accurately as you can. Try not to lift your finger while performing the test.
[0307] Start tracing from the green point specified within the letter and finish the trace at the red point. Please follow the arrows to ensure the letter is being traced in the right direction.
[0308] Once you successfully completed tracing a letter, click on the next button to proceed to the next letter.
[0309] In the user interface (illustrated in Fig. 35), as illustrated in Fig. 35, on the left side, under a title “HOW IT WORKS,” for example, an “explanatory diagram” and an “explanatory text” explaining performing the test (a) (letter tracing) with the left hand are displayed, and a “Practice” button and a “Get Started” button are displayed in a bottom row. On the other hand, on the right side, under a title “HOW IT WORKS,” for example, an “explanatory diagram” and an “explanatory text” explaining performing the test (a) (letter tracing) with the right hand are displayed, and a “Practice” button and a “Get Started” button are displayed in a bottom row.
[0310] An example of the explanatory texts is as follows, and it is common for both the left hand and the right hand.
[0311] Put your phone on a flat surface. Click on the begin button to start the test.
[0312] The test will contain a 3 letter word, each letter to be traced one at a time.
[0313] Trace each letter as accurately as you can. Try not to lift your finger while performing the test. Start tracing from the green point specified within the letter and finish the trace at the red point.
[0314] Please follow the arrows to ensure the letter is being traced in the right direction.
[0315] Once you successfully completed tracing a letter, click on the next button to proceed to the next letter.
[0316] In a scope without departing from the spirit of the present disclosure, the above-described embodiments may be combined, and, in each of the embodiments, a structural element may be deleted or modified as appropriate, and another structural element may be added.
[0317] Neuromuscular diseases are a general term for diseases that cause movement disorders due to lesions of the nerves themselves or the muscles themselves, such as those of the brain, spinal cord, and peripheral nerves. As described in Non-Patent Documents 1 - 3, representative diseases include Parkinson's disease, spinocerebellar degeneration, amyotrophic lateral sclerosis, neuritis or myelitis caused by viruses or bacteria, myasthenia gravis, muscular dystrophy, polymyositis, and the like. Movement disorder is a common main symptom of these neuromuscular diseases.
[0318] Among neuromuscular diseases, for example, amyotrophic lateral sclerosis (hereinafter also referred to as “ALS”) is a rapidly progressive fatal and serious disease in which voluntary movements are impaired due to selective degenerative loss of upper and lower motor neurons, weakness of upper and lower limbs or bulbar palsy and respiratory muscle palsy gradually progress, and respiratory management is often required due to respiratory failure 2 - 5 years after the onset of the disease. There are individual differences in type and progression of atrophied muscles in ALS patients. Further, since ALS does not have a specific marker, the current diagnosis is basically an exclusion diagnosis. As diagnostic criteria, for example, there are revised EL Escorial diagnostic criteria. However, since this diagnostic criteria has low diagnostic sensitivity, in practice, comprehensive clinical diagnosis is performed.
[0319] Further, another diagnostic criteria is electrophysiological examination. Since this examination imposes a heavy burden on the patient and progression or severity of a pathological condition cannot be tracked, progression of ALS is visually evaluated and highly sensitive diagnosis at an early stage is difficult.
[0320] Therefore, in order to evaluate limb ability quantitatively and objectively, in other words, to improve convenience of measuring limb ability, a motion capture technology is used as described in Japanese Patent No. 6465419.
[0321] However, when the above motion capture technology is used, even when an attempt is made to slow progression of a disease at an early stage, in other words, even when an attempt is made to start appropriate treatment after detecting a sign of a neuromuscular disease at an early stage, it was not possible to quantitatively and objectively detect a sign of a neuromuscular disease at an early stage.
[0322] An embodiment of the present invention is intended to perform quantitative and objective detection of a sign of a neuromuscular disease at an earlier stage compared to the conventional technology.
[0323] An information processing method according to an embodiment of the present invention includes, in a processing part of an information processing device that is connected to a user terminal device via a network: presenting at least one test related to fine motor movement among the following (a) - (h) to the user terminal device; generating an operation result according to an operation with respect to the test on the user terminal device having a touch panel; and generating to-be-provided information regarding a neuromuscular disease based on the operation result that has been acquired: (a) a test in which, with respect to a region that forms at least one reference letter presented to the user terminal device, an operation to trace the region on the touch panel is executed,
[0324] (b) a test in which a pinch-out or pinch-in operation is executed on the touch panel such that a target object on a test image presented to the user terminal device when a display magnification of the test image is at a first reference magnification enters a reference range,
[0325] (c) a test in which a pinch-in operation is executed on the touch panel such that a display magnification of a test image presented to the user terminal device changes from a second reference magnification to a third reference magnification,
[0326] (d) a test in which tap operations are sequentially executed on the touch panel with respect to two or more reference positions presented to the user terminal device,
[0327] (e) a test in which a tap operation on a reference object is executed on the touch panel with respect to two or more different types of moving objects presented to the user terminal device,
[0328] (f) a test in which an operation is executed to tilt the user terminal device such that an object presented to the user terminal device is positioned within a reference range,
[0329] (g) a test in which, in a maze image presented to the user terminal device, an object is moved from a start to a goal within the maze image by tilting the user terminal device, and
[0330] (h) a test in which, regarding a container object and a liquid object in the container object, which are presented to the user terminal device, with respect to the liquid object that flows out from the container object by executing an operation to tilt the user terminal device from a horizontal state, an operation is executed to maintain the horizontal state of the user terminal device within a predetermined test time such that the liquid object is kept in the container object.
[0331] According to the information processing method according to the embodiment of the present invention, quantitative and objective detection of a sign of a neuromuscular disease is performed at an earlier stage compared to the conventional technology.
[0332] Furthermore, various tests may be provided to a subject for different fine motor functions including eye-hand coordination, manual precision and accuracy, promptness and speed, grip balance and motor stability, spatial orientation, and cognitive function and attention. For example, the eye-hand coordination may be measured in all tests and may be measured by one or more tests selected from Test (a) to Test (h). For the manual precision and accuracy, a subject may be given one or more tests selected from Test (a), Test (b), Test (d), Test (e) and Test (g). For the promptness and speed, a subject may be given one or more tests selected from Test (a), Test (d), Test (e) and Test (g). For the grip balance and motor stability, a subject may be given one or more tests selected from Test (h) and Test (g). For the spatial orientation, a subject may be given one or more tests selected from Test (e), Test (h) and Test
[0333] (g). For the cognitive function and attention, a subject may be given one or more tests selected from Test (e), Test (h) and Test (g).
[0334] For two or more fine motor functions described above, a combination of the tests suitable to measure the fine motor functions of interest may be given to a subject. For example, for the manual precision and accuracy and the promptness and speed, one or more tests are selected from Test (a), Test (b), Test (d), Test (e) and Test (g) for the manual precision and accuracy, and one or more tests are selected from Test (a), Test (d), Test (e) and Test (g) for the promptness and speed. In other words, if there are two or more fine motor functions to be focused on, one or more tests will be selected from the group of tests suitable to measure those functions for the subject.
[0335] More preferably, a combination of Test (a), Test (b), Test (d), Test (e), Test (g) and Test
[0336] (h) provides more detailed information on the extent of neuromuscular disease progression and diagnosis. Test (c) in addition to Test (b) provides further information. Test (h) may be substituted with Test (f) to obtain the same information as Test (h).
[0337] The information processing device, the information processing system, the information processing method, the program, and the recording medium according to the embodiment of the present invention include, for example, the following structures.
[0338] Item 1
[0339] An information processing method includes, in a processing part of an information processing device that is connected to a user terminal device via a network: presenting at least one test related to fine motor movement among the following (a) - (h) to the user terminal device; generating an operation result according to an operation with respect to the test on the user terminal device having a touch panel; and generating to-be-provided information regarding a neuromuscular disease based on the operation result that has been acquired:
[0340] (a) a test in which, with respect to a region that forms at least one reference letter presented to the user terminal device, an operation to trace the region on the touch panel is executed;
[0341] (b) a test in which a pinch-out or pinch-in operation is executed on the touch panel such that a target object on a test image presented to the user terminal device when a display magnification of the test image is at a first reference magnification enters a reference range;
[0342] (c) a test in which a pinch-in operation is executed on the touch panel such that a display magnification of a test image presented to the user terminal device changes from a second reference magnification to a third reference magnification;
[0343] (d) a test in which tap operations are sequentially executed on the touch panel with respect to two or more reference positions presented to the user terminal device;
[0344] (e) a test in which a tap operation on a reference object is executed on the touch panel with respect to two or more different types of moving objects presented to the user terminal device;
[0345] (f) a test in which an operation is executed to tilt the user terminal device such that an object presented to the user terminal device is positioned within a reference range;
[0346] (g) a test in which, in a maze image presented to the user terminal device, an object is moved from a start to a goal within the maze image by tilting the user terminal device; and
[0347] (h) a test in which, regarding a container object and a liquid object in the container object, which are presented to the user terminal device, with respect to the liquid object that flows out from the container object by executing an operation to tilt the user terminal device from a horizontal state, an operation is executed to maintain the horizontal state of the user terminal device within a predetermined test time such that the liquid object is kept in the container object.
[0348] Item 1 Based on Modified Structure An information processing method includes, in a processing part of an information processing device that is connected to a user terminal device via a network: presenting at least one test related to fine motor movement among the following (a) - (h) to the user terminal device; generating an operation result according to an operation with respect to the test on the user terminal device having a touch panel; and generating to-be-provided information regarding a neuromuscular disease based on the operation result that has been acquired:
[0349] (a) a test in which, with respect to a region that forms at least one reference letter presented to the user terminal device, an operation to trace the region on the touch panel is executed;
[0350] (b) a test in which a pinch-out (magnify) or pinch- in (minimize) operation is executed on the touch panel such that a target object on a test image presented to the user terminal device when a display magnification of the test image is at a first reference magnification enters or exits a reference range;
[0351] (c) a test in which a pinch-in operation is executed on the touch panel such that a display magnification of a test image presented to the user terminal device changes from a second reference magnification to a third reference magnification;
[0352] (d) a test in which tap operations using two fingers are sequentially executed on the touch panel with respect to two reference fixed stationary targets presented to the user terminal device;
[0353] (e) a test in which a tap operation using one finger on a reference object is executed on the touch panel with respect to different types of moving targets presented to the user terminal device gradually increasing in number and speed;
[0354] (f) a test in which an operation is executed to tilt the user terminal device such that an object presented to the user terminal device is positioned within a fixed reference range parallel to the ground;
[0355] (g) a test in which an operation is executed to tilt the user terminal device using two hands to control the trajectory of a ball within a maze from a central start point to full exit; and
[0356] (h) a test in which an operation is executed to tilt user terminal device using two hands to maintain the device’s horizontal state within a fixed reference range such that the virtual liquid is kept in the cup object. Item 2
[0357] The information processing method according to Item 1 , wherein the operation result with respect to the test is an operation result of both an operation using the user's right hand and an operation using the user's left hand.
[0358] Item 3
[0359] The information processing method according to Item 1 , wherein, within a predetermined period, multiple types of tests related to fine motor movement among the (a) - (g) are presented to the user terminal device, and to-be-provided information related to a neuromuscular disease is generated based on the multiple types of tests related to fine motor movement.
[0360] Item 4
[0361] The information processing method according to Item 1 , wherein when the test includes the (a), the reference letters are two or more letters belonging to different types among multiple types classified from letters presented.
[0362] Item 5
[0363] The information processing method according to Item 1 , wherein the reference letters are two or more letters belonging to different types among letters formed of only straight lines, letters formed of only curves, and letters formed of a combination of straight lines and curves.
[0364] Item 6
[0365] The information processing method according to any one of Items 1 - 5, wherein the operation result of the test of (a) includes an operation result of at least one of
[0366] (a-1) a total number of times a finger is released from the touch panel,
[0367] (a-2) a total time during which the finger is released from the touch panel, (a-3) a total time to complete each letter,
[0368] (a-4) a total time to complete all letters,
[0369] (a-5) a total number of pixels traced outside the region,
[0370] (a-6) a ratio of a number of pixels, a time, or a distance of tracing outside the region to a total number of pixels, a total time, or a total distance of tracing all letters,
[0371] (a-7) a farthest distance of tracing outside the region,
[0372] (a- 8) a total distance of tracing each or all of letters, and
[0373] (a-9) an actual line image created by tracing the reference letter.
[0374] Item 7
[0375] The information processing method according to Item 1 , wherein when the test includes the (b), the test image is a map image, and the target object is a structure located at a predetermined latitude and longitude on the map image.
[0376] Item 8
[0377] The information processing method according to any one of Items 1 - 3 and 7, wherein the operation result of the test of (b) includes an operation result of at least one of the following (b-l) - (b-2):
[0378] 03-1) a total number of pinch-out or pinch-in movements performed until the first reference magnification is reached, and
[0379] 03-2) a total time until the first reference magnification is reached and the target object enters the reference range.
[0380] Item 9
[0381] The information processing method according to Item 1 , wherein when the test includes the (c), the test image is a map image. Item 10
[0382] The information processing method according to any one of Items 1 - 3 and 9, wherein the operation result of the test of (c) includes an operation result of at least one of the following (c-1) — (c-2):
[0383] (c-1) a total number of pinch-in operations performed until the third reference magnification is reached; and
[0384] (c-2) a total time until the third reference magnification is reached.
[0385] Item 11
[0386] The information processing method according to any one of Items 1 — 3, wherein when the test includes both the (b) and the (c), the first reference magnification and the second reference magnification are the same, and the test of (c) is executed after executing the test of (b).
[0387] Item 12
[0388] The information processing method according to any one of Items 1 - 3, wherein when the test includes the (d), the operation result of the test of (d) includes an operation result of at least one of the following (d-1) - (d-7):
[0389] (d-1) a total number of taps on the touch panel;
[0390] (d-2) a total number of taps with the right hand on the touch panel;
[0391] (d-3) a total number of taps with the left hand on the touch panel;
[0392] (d-4) a total number of taps with respect to the reference positions on the touch panel;
[0393] (d-5) an average speed of taps on the touch panel;
[0394] (d-6) a time interval between each tap or an average time interval between all taps on the touch panel; (d-7) coordinates of each tap, and
[0395] (d-8) an average deviation of tap coordinates from the reference positions.
[0396] Item 13
[0397] The information processing method according to Item 1 , wherein when the test includes the (e), the different types of moving objects are moving objects that are different from each other in at least one of color and shape.
[0398] Item 14
[0399] The information processing method according to any one of Items 1 - 3 and 13, wherein the operation result of the test of (e) includes an operation result of at least one of the following (e-l) - (e-4):
[0400] (e-1) a total number of taps on the reference object;
[0401] (e-2) a total number of taps on objects other than the reference object;
[0402] (e-3) a total number of taps on the touch panel;
[0403] (e-4) a total number of taps on regions other than the object;
[0404] (e-5) a distance from a center position of the reference object; and
[0405] (e-6) a total time until completion of a predetermined number of taps.
[0406] Item 15
[0407] The information processing method according to any one of Items 1 - 3, wherein when the test includes the (1), the operation result of the test of (f) includes an operation result of at least one of the following (f-1) - (f-4):
[0408] (f-1) a total time the object is positioned within the reference range;
[0409] (f-2) a total time the object is positioned outside the reference range;
[0410] (f-3) a total number of times the object is positioned within the reference range; (f-4) aposition of the object in each predetermined period; and
[0411] (f-5) an image of an actual trajectory along which the object has moved.
[0412] Item 16
[0413] The information processing method according to Item 1 , wherein when the test includes the (g), the maze image is added with a guide line from the start to the goal only during an initial test.
[0414] Item 17
[0415] The information processing method according to Item 1 , wherein when the test includes the (g), the same maze image is presented multiple times at different rotation angles.
[0416] Item 18
[0417] The information processing method according to any one of Items 1 - 3, 16 and 17, wherein the operation result of the test of (g) includes an operation result of at least one of the following (g-1) - (g-6):
[0418] (g-1) a result indicating success or failure with respect to the maze image;
[0419] (g-2) a total time from the start to the goal;
[0420] (g-3) a total deviation distance from an ideal path;
[0421] (g-4) a maximum deviation from the ideal path;
[0422] (g-5) finger position coordinates in each predetermined period; and
[0423] (g-6) an image of an actual trajectory along which the object has moved with respect to the maze image.
[0424] Item 19 The information processing method according to any one of Items 1 - 3, wherein the operation result of the test of (h) includes an operation result of at least one of the following (h-1) - (h-6):
[0425] (g-1) a total number of times the liquid object flows out from the container object;
[0426] (g-2) a maximum tilt angle of the user terminal device when the liquid object flows out from the container object;
[0427] (g-3) an average tilt angle of the user terminal device when the liquid object flows out from the container object;
[0428] (g-4) position coordinates of the user terminal device during the test;
[0429] (g-5) a position where the liquid object flows out from the container object;
[0430] (g-6) a ratio of time the liquid object flows out from the container object to the test time;
[0431] (g-7) a ratio of time the liquid object does not flow out from the container object to the test time;
[0432] (g-8) a total time the liquid object flows out from the container object; and
[0433] (g-9) a total time the liquid object does not flow out from the container object.
[0434] Item 20
[0435] The information processing method according to Item 1 , wherein the to-be-provided information is information regarding at least one of a current state of a fine motor function related to the neuromuscular disease, a change in fine motor function related to the neuromuscular disease, a sign of the neuromuscular disease, prediction of onset, and prediction of progression.
[0436] Item 21
[0437] The information processing method according to Item 1 , comprising notifying the generated to-be-provided information to a terminal used by any of a user, a caregiver of the user, and a healthcare provider. Item 22
[0438] An information processing device that is connected to a user terminal device via a network, and executes, in a processing part of the information processing device: presenting at least one of the following tests (a) - (h) related to fine motor movement to the user terminal device; generating an operation result according to an operation with respect to the test on the user terminal device having a touch panel; and generating to-be-provided information regarding a neuromuscular disease based on the operation result that has been acquired:
[0439] (a) a test in which, with respect to a region that forms at least one reference letter presented to the user terminal device, an operation to trace the region on the touch panel is executed;
[0440] (b) a test in which a pinch-out or pinch-in operation is executed on the touch panel such that a target object on a test image presented to the user terminal device when a display magnification of the test image is at a first reference magnification enters a reference range;
[0441] (c) a test in which a pinch-in operation is executed on the touch panel such that a display magnification of a test image presented to the user terminal device changes from a second reference magnification to a third reference magnification;
[0442] (d) a test in which tap operations are sequentially executed on the touch panel with respect to two or more reference positions presented to the user terminal device;
[0443] (e) a test in which a tap operation on a reference object is executed on the touch panel with respect to two or more different types of moving objects presented to the user terminal device;
[0444] (f) a test in which an operation is executed to tilt the user terminal device such that an object presented to the user terminal device is positioned within a reference range;
[0445] (g) a test in which, in a maze image presented to the user terminal device, an object is moved from a start to a goal within the maze image by tilting the user terminal device; and
[0446] (h) a test in which, regarding a container object and a liquid object in the container object, which are presented to the user terminal device, with respect to the liquid object that flows out from the container object by executing an operation to tilt the user terminal device from a horizontal state, an operation is executed to maintain the horizontal state of the user terminal device within a predetermined test time such that the liquid object is kept in the container object.
[0447] Item 23
[0448] An information processing system comprising: the information processing device according to Item 22; and the user terminal device.
[0449] Item 24
[0450] A program causing a processing part of an information processing device, which is connected to a user terminal device via a network, to execute: presenting at least one test related to fine motor movement among the following (a) (h) to the user terminal device; generating an operation result according to an operation with respect to the test on the user terminal device having a touch panel; and generating to-be-provided information regarding a neuromuscular disease based on the operation result that has been acquired:
[0451] (a) a test in which, with respect to a region that forms at least one reference letter presented to the user terminal device, an operation to trace the region on the touch panel is executed;
[0452] (b) a test in which a pinch-out or pinch-in operation is executed on the touch panel such that a target object on a test image presented to the user terminal device when a display magnification of the test image is at a first reference magnification enters a reference range;
[0453] (c) a test in which a pinch-in operation is executed on the touch panel such that a display magnification of a test image presented to the user terminal device changes from a second reference magnification to a third reference magnification;
[0454] (d) a test in which tap operations are sequentially executed on the touch panel with respect to two or more reference positions presented to the user terminal device; (e) a test in which a tap operation on a reference object is executed on the touch panel with respect to two or more different types of moving objects presented to the user terminal device;
[0455] (f) a test in which an operation is executed to tilt the user terminal device such that an object presented to the user terminal device is positioned within a reference range;
[0456] (g) a test in which, in a maze image presented to the user terminal device, an object is moved from a start to a goal within the maze image by tilting the user terminal device; and
[0457] (h) a test in which, regarding a container object and a liquid object in the container object, which are presented to the user terminal device, with respect to the liquid object that flows out from the container object by executing an operation to tilt the user terminal device from a horizontal state, an operation is executed to maintain the horizontal state of the user terminal device within a predetermined test time such that the liquid object is kept in the container object.
[0458] Item 25
[0459] A computer-readable recording medium on which the program according to Item 24 is recorded.
[0460] Obviously, numerous modifications and variations of the present invention are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims, the invention may be practiced otherwise than as specifically described herein.
Claims
CLAIMSClaim 1 : An information processing method, comprising, in a processing part of an information processing device that is connected to a user terminal device via a network: presenting at least one of tests (a) - (h) related to fine motor movement to the user terminal device; generating an operation result according to an operation with respect to the test on the user terminal device having a touch panel; and generating to-be-provided information regarding a neuromuscular disease based on the operation result that has been acquired, wherein the tests (a) — (h) related to fine motor movement include:(a) a test in which, with respect to a region that forms at least one reference letter presented to the user terminal device, an operation to trace the region on the touch panel is executed,(b) a test in which a pinch-out or pinch-in operation is executed on the touch panel such that a target object on a test image presented to the user terminal device when a display magnification of the test image is at a first reference magnification enters a reference range,(c) a test in which a pinch-in operation is executed on the touch panel such that a display magnification of a test image presented to the user terminal device changes from a second reference magnification to a third reference magnification,(d) a test in which tap operations are sequentially executed on the touch panel with respect to two or more reference positions presented to the user terminal device,(e) a test in which a tap operation is executed on the touch panel with respect to a reference object with respect to two or more different types of moving objects presented to the user terminal device,(f) a test in which the user terminal device is tilted such that an object presented to the user terminal device is positioned within a reference range,(g) a test in which, in a maze image presented to the user terminal device, an object is moved from a start to a goal within the maze image by tilting the user terminal device, and(h) a test in which, regarding a container object and a liquid object in the container object, which are presented to the user terminal device, with respect to the liquid object that flows out from the container object by executing an operation to tilt the user terminal device from a horizontal state, an operation is executed to maintain the horizontal state of the user terminal device within a predetermined test time such that the liquid object is kept in the container object.Claim 2: The information processing method according to claim 1, wherein the operation result with respect to the test is an operation result of both an operation using the user's right hand and an operation using the user's left hand.Claim 3: The information processing method according to claim 1, wherein within a predetermined period, multiple types of tests related to fine motor movement among the (a) (g) are presented to the user terminal device, and to-be-provided information related to a neuromuscular disease is generated based on the multiple types of tests related to fine motor movement.Claim 4: The information processing method according to claim 1, wherein when the test includes the (a), the reference letters are two or more letters belonging to different types among multiple types classified from letters presented.Claim 5: The information processing method according to claim 4, wherein the reference letters are two or more letters belonging to different types among letters formed of only straight lines, letters formed of only curves, and letters formed of a combination of straight lines and curves.Claim 6: The information processing method according to any one of claims 1 - 5, wherein the operation result of the test of (a) includes an operation result of at least one of(a-1) a total number of times a finger is released from the touch panel,(a-2) a total time during which the finger is released from the touch panel,(a-3) a total time to complete each letter,(a-4) a total time to complete all letters,(a-5) a total number of pixels traced outside the region,(a-6) a ratio of a number of pixels, a time, or a distance of tracing outside the region to a total number of pixels, a total time, or a total distance of tracing all letters,(a-7) a farthest distance of tracing outside the region,(a- 8) a total distance of tracing each or all of letters, and(a-9) an actual line image created by tracing the reference letter.Claim 7 : The information processing method according to claim 1 , wherein when the test includes the (b), the test image is a map image, and the target object is a structure located at a predetermined latitude and longitude on the map image.Claim 8: The information processing method according to any one of claims 1 - 3 and 7, wherein the operation result of the test of (b) includes an operation result of at least one of(b-l) a total number of pinch-out or pinch-in movements performed until the first reference magnification is reached, and(b-2) a total time until the first reference magnification is reached and the target object enters the reference range.Claim 9: The information processing method according to claim 1, wherein when the test includes the (c), the test image is a map image.Claim 10: The information processing method according to any one of claims 1 - 3 and 9, wherein the operation result of the test of (c) includes an operation result of at least one of(c-1) a total number of pinch-in operations performed until the third reference magnification is reached, and(c-2) a total time until the third reference magnification is reached.Claim 11 : The information processing method according to any one of claims 1 — 3, wherein when the test includes both the (b) and the (c), the first reference magnification and the second reference magnification are the same, and the test of (c) is executed after executing the test of (b).Claim 12: The information processing method according to any one of claims 1 - 3, wherein when the test includes the (d), the operation result of the test of (d) includes an operation result of at least one of(d-1) a total number of taps on the touch panel,(d-2) a total number of taps with the right hand on the touch panel,(d-3) a total number of taps with the left hand on the touch panel,(d-4) a total number of taps with respect to the reference positions on the touch panel,(d-5) an average speed of taps on the touch panel,(d-6) a time interval between each tap or an average time interval between all taps on the touch panel,(d-7) coordinates of each tap, and(d-8) an average deviation of tap coordinates from the reference positions.Claim 13 : The information processing method according to claim 1 , wherein when the test includes the (e), the different types of moving objects are moving objects that are different from each other in at least one of color and shape.Claim 14: The information processing method according to any one of claims 1 — 3 and 13, wherein the operation result of the test of (e) includes an operation result of at least one of(e-1) a total number of taps on the reference object,(e-2) a total number of taps on objects other than the reference object,(e-3) a total number of taps on the touch panel,(e-4) a total number of taps on regions other than the object,(e-5) a distance from a center position of the reference object, and(e-6) a total time until completion of a predetermined number of taps.Claim 15: The information processing method according to any one of claims 1 - 3, wherein when the test includes the (f), the operation result of the test of (f) includes an operation result of at least one of(f-1) a total time the object is positioned within the reference range,(f-2) a total time the object is positioned outside the reference range,(f-3) a total number of times the object is positioned within the reference range,(f-4) aposition of the object in each predetermined period, and(f-5) an image of an actual trajectory along which the object has moved.Claim 16: The information processing method according to claim 1, wherein when the test includes the (g), the maze image is added with a guide line from the start to the goal only during an initial test.Claim 17: The information processing method according to claim 1, wherein when the test includes the (g), the same maze image is presented multiple times at different rotation angles.Claim 18: The information processing method according to any one of claims 1 — 3, 16 and 17, wherein the operation result of the test of (g) includes an operation result of at least one of(g-1) a result indicating success or failure with respect to the maze image,(g-2) a total time from the start to the goal,(g-3) a total deviation distance from an ideal path,(g-4) a maximum deviation from the ideal path,(g-5) finger position coordinates in each predetermined period, and(g-6) an image of an actual trajectory along which the object has moved with respect to the maze image.Claim 19: The information processing method according to any one of claims 1 - 3, wherein the operation result of the test of (h) includes an operation result of at least one of(g-1) a total number of times the liquid object flows out from the container object,(g-2) a maximum tilt angle of the user terminal device when the liquid object flows out from the container object,(g-3) an average tilt angle of the user terminal device when the liquid object flows out from the container object,(g-4) position coordinates of the user terminal device during the test,(g-5) a position where the liquid object flows out from the container object,(g-6) a ratio of time the liquid object flows out from the container object to the test time,(g-7) a ratio of time the liquid object does not flow out from the container object to the test time,(g-8) a total time the liquid object flows out from the container object, and(g-9) a total time the liquid object does not flow out from the container object.Claim 20: The information processing method according to claim 1, wherein the to-be- provided information is information regarding at least one of a current state of a fine motor function related to the neuromuscular disease, a change in fine motor function related to the neuromuscular disease, a sign of the neuromuscular disease, prediction of onset, and prediction of progression.Claim 21 : The information processing method according to claim 1, comprising: notifying the generated to-be-provided information to a terminal used by any of a user, a caregiver of the user, and a healthcare provider.Claim 22: An information processing device connected to a user terminal device via a network, the information processing, device executing, in a processing part of the information processing device: presenting at least one of tests (a) - (h) related to fine motor movement to the user terminal device; generating an operation result according to an operation with respect to the test on the user terminal device having a touch panel; and generating to-be-provided information regarding a neuromuscular disease based on the operation result that has been acquired, wherein the tests (a) — (h) related to fine motor movement include:(a) a test in which, with respect to a region that forms at least one reference letter presented to the user terminal device, an operation to trace the region on the touch panel is executed,(b) a test in which a pinch-out or pinch-in operation is executed on the touch panel such that a target object on a test image presented to the user terminal device when a display magnification of the test image is at a first reference magnification enters a reference range,(c) a test in which a pinch-in operation is executed on the touch panel such that a display magnification of a test image presented to the user terminal device changes from a second reference magnification to a third reference magnification,(d) a test in which tap operations are sequentially executed on the touch panel with respect to two or more reference positions presented to the user terminal device,(e) a test in which a tap operation on a reference object is executed on the touch panel with respect to two or more different types of moving objects presented to the user terminal device,(f) a test in which an operation is executed to tilt the user terminal device such that an object presented to the user terminal device is positioned within a reference range,(g) a test in which, in a maze image presented to the user terminal device, an object is moved from a start to a goal within the maze image by tilting the user terminal device, and(h) a test in which, regarding a container object and a liquid object in the container object, which are presented to the user terminal device, with respect to the liquid object that flows out from the container object by executing an operation to tilt the user terminal device from a horizontal state, an operation is executed to maintain the horizontal state of the user terminal device within a predetermined test time such that the liquid object is kept in the container object.Claim 23 : An information processing system comprising: the information processing device according to claim 22; and the user terminal device.Claim 24: A program causing a processing part of an information processing device, which is connected to a user terminal device via a network, to execute: presenting at least one of tests (a) — (h) related to fine motor movement to the user terminal device; generating the operation result according to an operation with respect to the test on the user terminal device having a touch panel; andgenerating to-be-provided information regarding a neuromuscular disease based on the operation result that has been acquired, wherein the tests (a) — (h) related to fine motor movement include:(a) a test in which, with respect to a region that forms at least one reference letter presented to the user terminal device, an operation to trace the region on the touch panel is executed,(b) a test in which a pinch-out or pinch-in operation is executed on the touch panel such that a target object on a test image presented to the user terminal device when a display magnification of the test image is at a first reference magnification enters a reference range,(c) a test in which a pinch-in operation is executed on the touch panel such that a display magnification of a test image presented to the user terminal device changes from a second reference magnification to a third reference magnification,(d) a test in which tap operations are sequentially executed on the touch panel with respect to two or more reference positions presented to the user terminal device,(e) a test in which a tap operation on a reference object is executed on the touch panel with respect to two or more different types of moving objects presented to the user terminal device,(f) a test in which an operation is executed to tilt the user terminal device such that an object presented to the user terminal device is positioned within a reference range,(g) a test in which, in a maze image presented to the user terminal device, an object is moved from a start to a goal within the maze image by tilting the user terminal device, and(h) a test in which, regarding a container object and a liquid object in the container object, which are presented to the user terminal device, with respect to the liquid object that flows out from the container object by executing an operation to tilt the user terminal device from a horizontal state, an operation is executed to maintain the horizontal state of the user terminal device within a predetermined test time such that the liquid object is kept in the container object.Claim 25: A computer-readable recording medium on which the program according to claim 24 is recorded.