STEM industrial product authentication framework
Through the development of the STEM industrial product certification framework, the STEM literacy, characteristics and general abilities of products are evaluated, and the product certification level is given, which solves the problems of teachers identifying STEM industrial products and the problems of uneven market product quality, and improves students' comprehensive application capabilities and products quality.
Patent Information
- Application Number
- CN202410636510.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-05-22
- Filing Date
- 2024-05-22
- Publication Date
- 2024-11-22
AI Technical Summary
In the existing STEM education, teachers lack industrial practical experience and are difficult to effectively identify and use high-quality STEM industrial products, resulting in limited students' comprehensive application capabilities and lack of unified certification standards, resulting in uneven market product quality.
Develop a STEM industrial product certification framework to give product certification levels by evaluating the STEM literacy, product characteristics and general abilities of products, help consumers identify appropriate STEM industrial products, and provide certification standards for manufacturers.
It has improved teachers' ability to identify and use STEM industrial products, ensured that students have improved their comprehensive application capabilities, and provided the market with unified quality certification standards to improve product quality and educational effectiveness.
Smart Images

Figure CN119005724A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a framework for certifying science, technology, engineering and mathematics (STEM) industry products related to STEM. Background Art
[0002] 1.1. General and specific definitions of STEM education background and STEM industrial products
[0003] STEM stands for science, technology, engineering and mathematics. STEM industrial products are products based on science, technology, engineering and mathematics, which can help students deepen their understanding of STEM knowledge in practical applications. With the development of STEM education, STEM industrial products have become more and more diverse. However, many school teachers lack industrial practical experience and cannot effectively judge industrial products. This is a huge obstacle to the use of STEM industrial products. In order to solve this problem, the present application has developed a STEM industrial product certification framework, in which the present application applies a statistical classification algorithm to analyze the collected STEM industrial product data according to product characteristics, so as to more effectively develop the certification framework. This can help consumers identify STEM industrial products more accurately. This section comprehensively reviews the basic definitions of STEM education and industrial products, and discusses the components of STEM industrial products. The design, production and evaluation of training modules and functions of STEM industrial products are also proposed.
[0004] 1.1.1.STEM education
[0005] (A) General and specific definitions of STEM
[0006] For a specific definition, STEM is a combination of four subject abbreviations: science, technology, engineering, and mathematics. According to reference [1], the attributes of the four subjects in STEM can be generally defined as follows.
[0007] Science (S): The systematic study of the nature and behavior of matter and the physical universe, based on observation, experiment, and measurement, and the formulation of laws to describe these facts in general terms.
[0008] Technology (T): The branch of knowledge concerned with the creation and use of technological means and their interrelationship with life, society and the environment, drawing on subjects such as industrial arts, engineering, applied sciences and pure sciences.
[0009] Engineering (E): The art or science of applying pure scientific knowledge (such as physics or chemistry) to practical applications (as, for example, in the construction of engines, bridges, buildings, mines, ships, and chemical plants).
[0010] Mathematics (M): A group of related sciences, including algebra, geometry, and calculus, involving the study of number, quantity, shape, and space and their interrelationships through the use of specialized symbols.
[0011] (B) Definition of STEM education
[0012] STEM education is the intentional integration of the above topics and their associated practices, see reference [2]. STEM education approaches, see reference [3], create student-centered learning environments that promote learning practices of engineering solutions, problem solving, investigation, and constructing evidence-based explanations of various real-world phenomena through shared collaboration among educational institutions, families, and community partners (e.g., school districts, STEM industrial product manufacturers).
[0013] (C) STEM education and student careers
[0014] STEM education prepares students for the future workforce. STEM education is positioned to develop thinking that is reconceptualized as multiple and should be able to differentiate on multiple hierarchical models, which is an important aspect of future workforce qualifications, see reference [3]. Manosuttirit pointed out in reference [4] that students who receive high-quality STEM learning are able to think deeply and think well, which is the most important criterion for becoming educators, innovators, leaders, and researchers who solve the most pressing national challenges and even world challenges. STEM education is specifically designed to support students in their pursuit of research and innovation in their career paths (e.g., physical science research and engineering, see reference [5]), as well as their formative education. This type of education increases students' interest in further studying STEM components and STEM-related careers, see reference [6], thereby helping our future generations prepare to tackle the world's biggest problems (e.g., environmental pollution, global health). Therefore, STEM education is crucial to students' career development.
[0015] (D) STEM education and national development
[0016] STEM education is crucial for national development in the 21st century. Scientific and technological innovation has become increasingly important in the 21st century, see reference [7]. Globalization and the knowledge economy bring both benefits and challenges to a country's development. In order to better adapt to the highly technological and new information-based society, national development prefers and requires a better workforce with STEM capabilities, see reference [8]. The long-term potential productivity of an economy is determined by the legal and economic framework, and an important factor in improving this framework is the efficiency of the education system, see reference [9]. High-quality STEM education promotes multiple thinking (dividing thinking into multiple models at different levels) and problem-solving approaches, see reference [3], which improves the efficiency of education. Barcelona in reference
[10] suggested that innovation leads to processes that can ensure economic sustainability, and it also relies on a solid foundation in integrated STEM development. Therefore, high-quality STEM education is conducive to the economic development of an economy.
[0017] 1.1.2. Industrial products
[0018] (A) General and specific definitions of industrial products
[0019] Industrial products are specifically referred to as intermediate goods or producer goods; see reference
[11] . Industrial products can also be defined generally as a general term for any man-made durable good (reference
[12] ) that is purchased by a firm or producer (reference
[13] ) as an input into a manufacturing process and that does not have any independent status (reference
[14] ). Industrial products are input factors required to provide services or to produce other goods (including final goods; see reference
[15] ) that are sold or supplied to other individuals or organizations; see reference
[16] . Final goods, also called consumer goods, are final goods produced by firms and purchased by consumers that can be used directly to satisfy human needs; see references
[16] ,
[17] .
[0020] (B) Examples of Industrial Products
[0021] Although industrial products and final goods are relative, many products can be described by both terms. Therefore, to define whether a product is an industrial product, its intended use must be considered.
[0022] Power plants and oil drilling equipment are industrial products because they are used to produce electricity and oil for consumption, respectively, see reference
[15] . Products such as cars can be both final goods and industrial products, see reference
[15] . If cars are used for the transportation of final goods, they are identified as industrial products, private transportation, and final goods.
[0023] 1.1.3.STEM industrial products
[0024] Before defining STEM industrial products, some STEM products should be defined first, because these STEM products may not be produced through industrial processes.
[0025] Definition of STEM Products :STEM products are products that help users apply knowledge and skills in science, technology, engineering and mathematics to design, use, development and innovation.
[0026] Such products are usually designed to solve real-world problems and are used in many fields such as systems engineering, medical industry, agriculture, military, etc.
[0027] (A) General and specific definitions of STEM industry products
[0028] Industrial products are products that are purchased and used for processing or commercial operations, see reference
[11] . The difference between consumer products and industrial products lies in the purpose for which they are purchased. There are many ways to classify industrial products. One is based on the producer's perspective and the way the product is purchased, while the other is based on the manufacturer, production method and cost. The latter classification standard is more widely used in industry. STEM industrial products can be specifically defined as industrial products that can apply knowledge related to science, technology, engineering and mathematics, see reference
[18] , to promote related education, such as cultivating modern electronic processing capabilities, scientific and technological development capabilities, and social problem-solving capabilities.
[0029] STEM industrial products cannot be derived from a complex STEM education system, see reference
[19] . In a general definition, STEM industrial products are man-made, durable, non-final goods, see reference
[12] , that are used as inputs in a manufacturing process and have educational value in a combination of science, technology, engineering, or mathematics topics.
[0030] (A.1) Specific definition of STEM industry products:
[0031] STEM industrial products can be specifically defined as STEM industrial products designed for STEM-related educational purposes for teaching science, technology, engineering and mathematics, such as for teaching modern electronic computing skills, science and technology development skills, digital and data literacy, etc., in a way that can be used by students of all ages and abilities, taking into account the characteristics of the product, and can develop general skills such as curiosity, critical thinking, problem-solving ability, etc.
[0032] Common STEM-specific industrial products include educational toys and games that support the learning process, advanced robots, coding kits, 3D printers, building kits and virtual reality headsets, technology-based tools, drones, smart planters, etc.
[0033] (A.2) General definition of STEM industrial products:
[0034] In a general definition, STEM industrial products are products that are manufactured through industrial processes using raw materials and components, and they have educational value in a combination of science, technology, engineering or mathematics topics. STEM industrial products cannot be derived from a complex STEM education system. It may also refer to specific industry sectors and specific products, such as solar cars, educational toys, game websites, educational software, video games, puzzles and project kits.
[0035] Examples of STEM industry product applications include computers and electronics, architectural and engineering services, software development, healthcare, physical, and life science products.
[0036] (B) Application of STEM industrial products
[0037] In STEM education, STEM industrial products may be STEM-oriented toys or supplementary exercises. These industrial products provide students with comprehensive hands-on experience, which is one of the main learning paths of STEM education, see reference
[20] . STEM industrial products should include the following features: application of STEM knowledge, problem-solving skills, stimulation of diverse thinking (reference
[21] ), and arousing interest in STEM education (reference
[22] ).
[0038] 1.2. Establish a STEM industry product certification framework
[0039] STEM education is essential for science and technology-based innovation, which is a key education reform strategy for many countries seeking to improve their technical workforce and economy. In addition to STEM education, there are other similar educational disciplines that are more comprehensive than STEM, called STEAM (Science, Technology, Engineering, Arts, Mathematics), because STEAM includes learning components related to both science and art. However, since the art learning component is subjective, diverse, and unmeasurable, and is customized according to the needs of the user at a later stage, STEAM will not be discussed and analyzed in this invention.
[0040] In contrast, the work of the present invention focuses more on the qualitative research of STEM development. Patent documents previously associated with STEM education and industrial products include US2007 / 0269773A1, US6,669,486B2, US6,862,696B1, US6,934,028B2, US8,015,039B2, CN107453872A, US2014 / 0370487A1, US9,691,294B2, JP3027583U, US2008 / 0233550A1, US6,529,705B1 and WO2014 / 134,633A2. Many of these studies show the correlation between student learning and educational teaching aids including educational industrial products. Students' learning experience of STEM industrial products will improve learning efficiency. However, the current problem with using STEM industrial products is that many teachers lack practical industrial engineering knowledge, which limits their ability to provide effective STEM education to students. And there are no universal standards for STEM industrial products for manufacturers to follow.
[0041] 1.3. The development of a STEM industry product certification framework involves two (2) technical challenges
[0042] STEM industrial products are different from industrial products. The development of a STEM industrial product certification framework should be different from the existing industrial product certification framework. The existence of the above-mentioned problems will also directly affect the effect of students using STEM industrial products. The quality of STEM industrial products on the market varies. Manufacturers do not have a unified standard to develop STEM industrial products. At present, there is no unified standard certification framework to help teachers and other consumers identify more effective STEM industrial products. The work of this invention attempts to establish a STEM industrial product certification development framework so that consumers can find suitable and effective STEM industrial products among the many products on the market.
[0043] The problem of insufficient integration of science, technology, engineering and mathematics is also reflected in STEM industrial products. Many STEM industrial products cannot balance STEM well, which makes the product incomplete and unable to improve students' comprehensive application ability. In the process of promoting and popularizing STEM education, some challenges have gradually emerged. The following two challenges also affect the development of the STEM industrial product certification framework.
[0044] 1.3.1. The first challenge in framework development
[0045] The first challenge involves actively incorporating science, technology, and engineering into the curriculum. STEM has struggled with its identity since its inception, and the most pressing challenge facing STEM education is recognizing what STEM actually means. This identity issue can be seen in the misconception that STEM focuses on emphasizing a particular subject to the exclusion of others, which is not its intention. The purpose of STEM is to use the effectiveness of these important subjects to integrate them into practical industrial applications.
[0046] Scientists study the “why” of scientific discoveries, but engineers focus on the “how” of using scientific discoveries and designing them into products (technology). Therefore, technology and engineering topics should not be seen as merely additional topics, but rather as integrated topics, as technology is the product of engineering design activities. Most current STEM strategies do not meet the requirements of design, iteration, and creation as part of their curriculum. STEM curriculum design should provide students with conscious support to build knowledge and skills across and within disciplines, but this support is often lacking currently, see reference
[23] .
[0047] Engineers need to apply science and mathematics to the study of engineering, but this does not apply to scientists and mathematicians, as there is no engineering requirement for the study of science and mathematics. This analogy can be used to explain why academic teachers have no experience and understanding of the means and methods used in industry. Therefore, a better partnership with industry is needed to move from a content-based paradigm to a skills-based paradigm, see reference
[24] .
[0048] Strimel et al.
[25] proposed three approaches to engineering education. The first is to continue using current technology and engineering teaching methods. Second, collaboration between engineering and science education professionals is needed to discover the differences and distinctions between the two fields. The third and most feasible approach is to build engineering education by leveraging the engineering community's investment in engineering content and practice.
[0049] The problem of insufficient integration of science, technology, engineering and mathematics is also reflected in STEM industrial products. Many STEM industrial products cannot balance STEM well, which makes the products incomplete and unable to enable students to improve their comprehensive application capabilities.
[0050] 1.3.2. The second challenge in the development of the framework
[0051] STEM education courses should include the application of knowledge to STEM-related real-world applications. Generally speaking, STEM education is more focused on science or mathematics, with little involvement in technology and engineering. This must be corrected in order for STEM education to have a positive impact on students, as engineering and technology can be difficult for academically minded teachers without industrial experience to grasp. Teachers are often better at content knowledge but lack the application of technology in real-world situations. The biggest challenge in providing effective STEM education courses is that teachers lack the engineering skills to connect them to students, see reference
[23] . Teachers are unable to lead students to use STEM industrial products satisfactorily, nor can they identify which STEM industrial products can help students more effectively. Summary of the invention
[0052] Mathematical equations cited in this Summary of the Invention can be found in the Detailed Description of the Invention.
[0053] The present invention relates to establishing a STEM industry product certification framework that can be used by industry sectors (e.g., product manufacturers and suppliers) and consumers (e.g., educators, parents, and students) to identify and classify STEM industry products.
[0054] One aspect of the present invention is to provide a method for authenticating STEM industry products.
[0055] The method includes: evaluating and scoring the level of STEM literacy that can be obtained by using the product, thereby obtaining a first score on STEM literacy; evaluating and scoring product characteristics that can be found in the product, thereby obtaining a second score on product characteristics; evaluating and scoring general abilities that can be learned after using the product, thereby obtaining a third score on general abilities; making a final decision on the total score of the product based on the first score, the second score and the third score; and granting the product a certification level based on the total score of the product.
[0056] If the product is hardware only, preferably, the evaluation and scoring of product characteristics includes evaluating the product separately in the following review categories: ergonomics; aesthetics; functionality; safety and reliability; product price; weight and size; materials; durability; manufacturing quality; strength and stability; environmental characteristics; resources or accessories; regulatory compliance; and maintenance and repair services; thereby obtaining a second score.
[0057] If the product is software only, preferably, the evaluation and scoring of product characteristics includes evaluating the product separately in the following review categories: usability; reliability; compatibility; portability; testability; scalability; flexibility; functional applicability; maintainability and repair service; interoperability; performance efficiency; product price; and security; thereby obtaining a second score.
[0058] If the product has hardware components and software components, the evaluation and scoring of product characteristics preferably includes: (a) evaluating the hardware components separately in the following review categories: ergonomics; aesthetics; functionality; safety and reliability; product price; weight and size; materials; durability; manufacturing quality; strength and stability; environmental characteristics; resources or accessories; regulatory compliance; and maintenance and repair services; thereby obtaining a fourth score for product characteristics related to the hardware components; (b) evaluating the software components separately in the following review categories: usability; reliability; compatibility; portability; testability; scalability; flexibility; functional applicability; maintainability and repair services; interoperability; performance efficiency; product price; and security; thereby obtaining a fifth score for product characteristics related to the software components; and (c) obtaining the second score by averaging the fourth and fifth scores.
[0059] Preferably, general competencies include: critical thinking; communication; creativity; collaboration; problem solving; data literacy; digital literacy; initiative; curiosity; grit; adaptability; leadership; and social and cultural awareness.
[0060] In certain embodiments, the product total score is calculated as a weighted average of the first score, the second score, and the third score.
[0061] In calculating the total score, the respective weighting factors of the first score, the second score, and the third score may be unified.
[0062] In some embodiments, making a final determination on the total score includes: normalizing the first score, the second score, and the third score to obtain normalized scores for STEM literacy, product characteristics, and general ability, respectively; and calculating the total score by averaging the normalized scores for STEM literacy, product characteristics, and general ability.
[0063] In certain embodiments, the normalized scores for STEM literacy, product characteristics, and general capabilities are calculated by equation (1) and the total score is calculated by equation (2).
[0064] In some embodiments, granting a product certification level based on the total score of the product includes: when 77%≤Y≤100%, determining the certification level to be 5, where Y is the total score expressed as a percentage, which is used to describe that the product quality has reached an excellent level; when 60%≤Y<77%, determining the certification level to be 4, which is used to describe that the product quality has reached a good level; when 50%≤Y<60%, determining the certification level to be 3, which is used to describe that the product quality has reached an average level; when 40%≤Y<50%, determining the certification level to be 2, which is used to describe that the product quality has reached a basic level; and when 0%≤Y<40%, determining the certification level to be 1, which is used to describe that the product quality has reached a poor level that does not meet the quality standards.
[0065] Other aspects of the present invention are disclosed by way of illustration in the following embodiments. BRIEF DESCRIPTION OF THE DRAWINGS
[0066] Figure 1 Two flow charts showing workflows for comparison are depicted, one based on conventional techniques and the other based on the technique proposed in this application.
[0067] Figure 2 The workflow of the proposed technique according to some embodiments of the invention is depicted.
[0068] Figure 3 A proposed framework for STEM industry product certification according to certain embodiments of the present invention is described.
[0069] Figure 4 Describes the components and certification framework for STEM industry products.
[0070] Figure 5 Depicted are the general building blocks of STEM industry product components.
[0071] Figure 6 A flow chart showing the synthesis of IPD products is depicted.
[0072] Figure 7 A general procedure for STEM industrial product design from reference
[39] is depicted.
[0073] Figure 8 A diagram illustrating an authentication process is depicted.
[0074] Fig. 9 Figures depicting assessment and scoring for STEM literacy: (a) an example of a STEM literacy score for a STEM product; and (b) a four-elliptical Venn diagram of possible types of STEM products.
[0075] Fig.10 Depicting three different kettles and their product characteristics analysis (Source: https: / / www.tes.com / teaching-resource / product-analysis-cards-11647721 ).
[0076] Fig.11 A first example of a product characteristic score for a STEM product is provided (Case 1: Hardware only).
[0077] Fig.12 A second example of a product characteristic score for a STEM product is provided (Case 2: software only).
[0078] Fig.13 Examples of basic qualities, qualifications and character traits are depicted (Source: https: / / enterrasolutions.com / blog / stem-education-helps-teach-skills-necessary-for- 21st-century-success / ).
[0079] Fig.14 Examples of scores on general abilities after using STEM products are provided.
[0080] Fig.15 Computational scores for products (with hardware only) are shown: (a) STEM literacy score for a STEM product; (b) product feature score for a STEM product; and (c) general capability score for a STEM product.
[0081] Those skilled in the art will appreciate that elements in the drawings are illustrated for simplicity and clarity and are not necessarily drawn to scale. DETAILED DESCRIPTION
[0082] 2. Solutions proposed for the above two challenges:
[0083] Figure 1 A flow chart illustrating conventional techniques and the techniques proposed in this application is shown. Figure 2 The workflow of the technology proposed in this application is illustrated as an example. The work proposed in this application is summarized as follows:
[0084] The research methods of this application Figure 2 ) includes the following 5 steps.
[0085] Step 1. Background research: Review of general and specific definitions of STEM industry products and related matters.
[0086] Step 2. Definition of STEM industrial components: Comprehensive study of various STEM components of STEM industrial products (S = science, such as sensors; T = technology, such as basic artificial intelligence; E = engineering, such as electronics / electrical / mechanical / industrial processes; M = mathematics, such as data clustering and analysis).
[0087] Step 3.STEM industry product classification: defines the common building blocks and functional blocks in STEM industry products, and classifies STEM industry products by functionality.
[0088] Step 4. Integrated Product Development (IPD): Integrated product development of STEM industrial products.
[0089] Step 5. STEM Industry Product Certification Framework: Development of a STEM Industry Product Certification Framework and Process.
[0090] Steps 1, 2, and 3 above address challenge (i) in Section 1.3.1, and steps 4 and 5 above address challenge (ii) in Section 1.3.2.
[0091] The framework proposed in this application ( Figure 3 ) allows for the certification of STEM industrial products to help consumers identify industrial products with STEM elements and also provides a means for product manufacturers to certify their products for STEM education.
[0092] Therefore, there is a need for a systematic and detailed investigation into the development of a certification framework for STEM industrial products.
[0093] The present invention has studied the development of a STEM industry product certification framework, and Step 3 (STEM industry product classification through design, production and assessment (DMA)), Step 4 (Integrated product development) and Step 5 (STEM industry product certification framework) are considered to be very important for facilitating the initial evaluation of the basic training blocks, characteristics, certification framework and processes of STEM industry products in this application.
[0094] This section describes the development of a framework proposed in this application for STEM industry product certification.
[0095] 2.1. Development of Design, Fabrication, and Assessment (DMA) for Identifying Training Blocks and Features for STEM Industrial Products
[0096] The development of training blocks and features of STEM industrial products requires background research, comprehensive research, and definition / classification of the building blocks of STEM industrial products, as described in Sections 2.1.1, 2.1.2, and 2.1.3, respectively. Many STEM industrial products can be viewed as modular architectures that follow a design, production, and evaluation process. STEM fields with features that fit into specific training blocks in the design, production, and evaluation processes have been identified for evaluation in STEM industrial product development. By definition, design is the act of formulating the form of something (such as by drawing a sketch or outline or plan); making something is the act or process of producing or creating it. Evaluation is a consideration and judgment. Sections 2.1.1, 2.1.2, and 2.1.3 can be viewed as the work required in the review of the design, production, and evaluation processes of STEM industrial products, respectively.
[0097] 2.1.1. (Design Review) Background Investigation:
[0098] Background research on STEM industrial products and related definitions. An example of a review for this section is described. In order to gain a deeper understanding of the challenges faced by STEM industrial products, the first question that this application needs to address is definition: What is a specific definition of a STEM industrial product? There are broad definitions of STEM education, but they are not yet applicable to STEM industrial products and tools. This application conducted an extensive literature review, surveys, and meetings to gain a deeper understanding of STEM industrial products and the tools needed for successful implementation.
[0099] The definitions and existing STEM education frameworks were reviewed and the relevance of the framework for producing STEM industrial products was defined
[26] .
[0100] The literature review using the approach of Reche et al.
[27] was as follows:
[0101] i) Keyword selection, such as science, technology, engineering, mathematics and STEM products. This includes the relationship between keywords.
[0102] ii) Select journals and high-quality articles related to the topic. After identifying the appropriate keyword combination, classify and analyze the search results.
[0103] iii) Inclusion and exclusion criteria were defined. These criteria were to verify the relationship between the article and the research topic. Inclusion criteria included keywords such as science, technology, engineering, mathematics, product development, standards and frameworks. Exclusion criteria included syllabus and education roadmap.
[0104] iv) Select the articles most relevant to the topic and conduct extensive analysis of the content.
[0105] 2.1.2. (Production Review) Definition of STEM Industrial Components:
[0106] The study of various STEM components of industrial STEM products (S = science, such as sensors; T = technology, such as basic artificial intelligence; E = engineering, such as electronics / electrical / mechanical / industrial processes; M = mathematics, such as data clustering and analysis) is as follows.
[0107] The general building blocks of STEM industrial products refer to the basic elements or parts that can be used as a unit together with many other things to form the entire STEM industrial product. All building blocks are parts of STEM industrial products. Generally speaking, all the parts of STEM industrial products, such as Figure 4 and Figure 5 As shown in Figure 1, it can be divided into two parts: hardware and software. Figure 5 As depicted, all STEM industry products can ultimately be divided into five main components: input unit, control unit, arithmetic unit, storage unit, and output unit.
[0108] Note: Any additional parts or supplementary tools required to use a STEM Industries product are classified as accessories.
[0109] Hardware can refer to the physical components of any computer or telecommunication system. It is a manufactured product that may refer to tools, machinery, and other durable equipment. The hardware part can be divided into functional parts and structural parts. For functional parts, they are four main categories of blocks: sensing modules, computing modules, execution modules, and common modules. The sensing module senses signals from the environment, which include light, sound, touch, motion, and distance from an object, and then passes the signal to the connected adjacent blocks. The computing module applies functions to these signals, including arithmetic functions that calculate numbers from two or more numbers, such as sum, maximum, minimum, reciprocal, and threshold. The execution module converts the received signals into various types of actions. The common module includes a power block, which includes a battery that must be included in each construction, such as a lithium-ion battery or a solar cell. Structural components refer to some supporting structures, such as columns, columns, and beams.
[0110] Software can refer to a set of instructions, data or programs used to operate a computer, device system and perform specific tasks. For example, assembly language, C language, C++, AppInventor, etc. Software is different from hardware, which describes the physical aspects of a computer or device system. Software is a general term used to refer to programs, scripts and applications that run on a device system. It can be considered as a variable part of a computer or device system, while hardware is an immutable part. There are different categories of software, such as application software, system software, programming software and middleware software. Applications are software used to meet specific needs or perform tasks. System software is designed to run computer hardware and provide a platform for applications to run. Programming software provides programming tools required by software developers. Middleware software is located between system software and applications, while driver software operates computer devices and peripherals.
[0111] 2.1.3. (Evaluation) STEM industry product classification:
[0112] The general building blocks in STEM industry products are defined and classified by function as described below.
[0113] A product consists of its physical items and functional items. The overall performance of a product depends on the integration of the individual operational functions and the physical elements of the product (such as its parts, components, and assemblies that enable the performance of the product's functions). In general, the physical elements of a product consist of several major physical building blocks. Each of these blocks is a collection of parts used to perform certain functions and can be composed of interchangeable parts to produce similar functions. The construction of a product is the result of arranging the functional elements into building blocks
[28] .
[0114] After obtaining a clear definition of STEM industry products and characteristics, the application can begin to define the key building blocks of STEM industry products. This is achieved by using both a literature review and a survey of STEM teachers. Qualitative research methods are an important complement to traditional quantitative research.
[0115] Many STEM industrial products that use coding have a block-based programming structure in which novice programmers are able to create functional programs by dragging and dropping individual blocks onto a workspace, reducing the number of cumbersome commands and syntax requirements, see Ref.
[29] . This simpler representation system allows these types of products to be easy to use.
[0116] This application develops important attributes of a good framework for STEM industrial products (e.g., toys). The general building blocks of STEM industrial products should include basic skills being developed, such as critical thinking, problem solving, creativity, communication, collaboration, data literacy, digital literacy, and computer science, see reference
[26] .
[0117] In addition, STEM industrial products can be divided into three categories according to their functions, see reference
[30] . For the first category, its function is to understand and learn "theory (T)". For the second category, its function is to build a "bridge (B)" for display, communication, and cooperation. As for the third category, its function is to develop solutions and "achieve (R)" specific goals.
[0118] Some examples of products in each category are listed below:
[0119] Category (T): Programming education products, Lego building blocks, mechanical toys, etc.
[0120] Category (B): 3D printers, drones, virtual reality goggles, etc.
[0121] Category (R): Robots that perform specific functions, such as dishwasher robots, cooking robots, grocery store shopping robots, etc.
[0122] Some STEM industrial products may involve multiple categories in terms of functions, so the functions of STEM industrial products can be expressed as the proportion of different categories. For example, a programmable football robot can be used to understand the principles of programming, and it can also realize the function of the robot kicking a ball. Therefore, it can be divided into 50% category (T) and 50% category (R). Theoretically, in terms of product functions, category (T), category (B) and category (R) belong to low-level, medium-level and high-level respectively. STEM industrial products with low-level category (T) can be converted into medium-level or high-level components after assembling some higher-level category components. STEM industrial products with high-level components can also be split into several low-level components after disassembling some lower-level category components.
[0123] (A) Research on training blocks for STEM industrial products
[0124] Training blocks are defined as a series of quantitative structures for STEM industrial product users to acquire specific capabilities related to the characteristics of STEM industrial products.
[0125] People who use STEM industry products can use training blocks to acquire general abilities such as critical thinking, communication skills, collaboration skills, creativity skills (reference
[31] ), innovation skills, information technology skills, computing skills, spatial thinking skills, problem-solving skills, management skills, self-learning skills, teamwork skills, work organization skills, skills to improve one’s own learning and performance (reference
[32] ), data literacy skills, digital literacy skills, and so on.
[0126] (B) Research on the characteristics of STEM industrial products
[0127] The characteristics of STEM industry products can be classified into tangible and intangible. Tangible characteristics can refer to the packaging and warranty of the product. Intangible characteristics are the symbols of the product, such as brand image. Intangible characteristics can include, for example, image and the level of relationship between the service provider and the customer. People decide which products to buy after considering both the tangible and intangible characteristics of the product.
[0128] The characteristics of STEM industrial products include tangible characteristics and intangible characteristics. Tangible characteristics are size, color, weight, volume, smell, taste, touch, quantity, material composition, observability, spatial relationship, etc., and intangible characteristics are price, quality, reliability, beauty or aesthetics, safety, functionality, economy, durability, maintainability, applicability, practicality, controllability, robustness, etc.
[0129] 2.2. Integrated Product Development (IPD): Integrated Product Development of STEM Industrial Products
[0130] 2.2.1.IPD Review
[0131] Compared with traditional approaches, the integrated product development (IPD) approach has many advantages and has become a paradigm for new product development, see reference
[33] . IPD uses interactions in overlapping, parallel execution, and concurrent workflows to evaluate STEM industrial products. It is used to view the coordination of systems within STEM industrial products, such as interdependent conflict mitigation and interpretation alignment elements involving the four components of STEM (science, technology, engineering, and mathematics). Both the quality and IPD characteristics of STEM industrial products are evaluated. In addition, factors that deteriorate IPD characteristics are identified to reduce their impact on the effectiveness of STEM industrial products, see references
[33] ,
[34] .
[0132] IPD is a framework based on the integrated design of products, manufacturing, and support processes. It recommends that all competing factors or "ilities" be considered from the initial stages of product development and design to the product in question; see reference
[35] . The term "ilities" refers to different kinds of software quality; see reference
[36] (e.g., testability, reliability; see reference
[37] ), often informally referred to as "ilities" because their names mostly end in "ilities". The main goal is to help management and active project teams achieve innovation goals; see reference
[38] .
[0133] 2.2.2. Benefits of IPD
[0134] By implementing IPD for new product design and development using a formal, structured approach, these costs can be reduced, product quality and performance can be improved, and time to market can be shortened. Using the concepts of IPD can make the design of STEM industry products more scientific and cost-effective.
[0135] The basic principles of integrated product development can be summarized as follows:
[0136] -Understand manufacturers, teachers and students and their requirements.
[0137] -Integrate R&D, product development and process investments with overall business strategy.
[0138] -Use product development teams to facilitate early involvement and concurrent design.
[0139] - Concurrently design products and manufacturing and supporting processes.
[0140] -Involve suppliers early in the development process.
[0141] -Use digital product models to capture and maintain a more complete and consistent representation of the design.
[0142] -Integrate CAE, CAD and CAM tools to improve efficiency and shorten design cycle time.
[0143] -Electronically simulate product performance and manufacturing processes to reduce costly design / build / test iterations.
[0144] -Use quality engineering and reliability techniques to develop more robust product and process designs.
[0145] -Create an efficient and streamlined development path to reduce costs and design cycle time.
[0146] -Continuously improve the design process.
[0147] There is currently no research directly focusing on the integrated product development (IPD) of STEM industrial products. Figure 6 The steps for the synthesis of IPD products are shown in FIG. Figure 7 The process of designing STEM industrial products is described from the perspective of biological evolution, which determines possible solutions and solution space, see reference
[39] . In general, from the idea of a product to its realization, it can be roughly divided into Figure 7The first step is the requirement specification and realization part. In this part, it is necessary to carefully analyze the product's demand positioning and at the same time examine the situation analysis of existing products. In summary, a relatively accurate product positioning can be obtained. In the second step, the product functions and their structures are determined. Consider the implementation of each functionality and arrange the functional structure of the product logically to achieve the best design.
[0148] In the third step, find the solution principle and its structure. Consider the scientific knowledge principles involved in the realization of the function, and make the product structure reasonable, safe and reliable by reasonably arranging the realization steps. In the fourth step, organize into achievable modules. In this part, the feasibility of each option is analyzed. Establish as many shared module units as possible to realize specific functions in a combined way. The fifth step is the implementation design of the relevant modules. In this part, it is mainly the analysis of the completed functional modules. The sixth step is to design the entire product. Integrate the entire product according to the achievable functions. The seventh step is to prepare the execution and use documents. In this part, what needs to be done is to undertake the previous functions and then specify the product manual. These seven steps can be repeated as needed, or some steps can be skipped to finally obtain good product performance. The above steps can be summarized into four main aspects: planning, conception, design and preparation. Product requirements affect the solution space. The knowledge and solution patterns used limit the solution space. Finally, all principles and rules are used in the solution space to evolve and optimize into products.
[0149] 2.3. Development of a STEM Industry Product Certification Framework and Process
[0150] In addition to developing the training blocks and features mentioned in Section 2.1, the development of a STEM industrial product certification framework also needs to consider integrated product development as described in Section 2.2, statistical methods for two online surveys of STEM product manufacturers and STEM educators, and the frameworks and processes required for STEM industrial products as described in Sections 2.3.1 and 2.3.2.
[0151] The test bed for this application work used 18 purchased STEM industrial products. Two online questionnaires were prepared for STEM product manufacturers and educators. The questionnaires were sent to STEM product manufacturers and educators to collect the information required for the development of the STEM industrial product certification framework to be completed in Section 2.3.2.
[0152] 2.3.1. Two things for manufacturers and educators share Statistical Methods for Online Surveys
[0153] Different statistical analysis methods were used to identify product features for modular product development. Reliability and validity, one-way ANOVA, two-way ANOVA, and Pearson correction analysis were considered as four appropriate statistical analysis methods for this application work to determine the significant impact of each relevant product feature based on the responses collected from two online surveys of manufacturers and educators. SPSS and Minitab software were used for statistical analysis in this application work.
[0154] 2.3.2.STEM Industry Product Certification Framework:
[0155] The framework and process for STEM industry product certification are described below.
[0156] Based on the literature review and the work done in this project, a certification framework for STEM industrial product certification is proposed as follows:
[0157] According to the definition of STEM industrial products (refer to Section 1, Section 2.1 and Figure 8 ), if the product passes all required tests and meets the relevant requirements, the following three aspects will be determined.
[0158] (1) Evaluate and score the level of STEM literacy that can be acquired through the use of the product.
[0159] (2) Evaluate and rate product characteristics that can be found in the product.
[0160] (3) Evaluate and rate the general abilities (qualifications) that can be acquired after using the product.
[0161] After all the requirements in the assessment are met, the STEM industrial product certification will be issued and a certification report will be issued. The certification report will show the STEM product component analysis, functional analysis, STEM teaching suggestions, use, reporting, etc.
[0162] like Figure 8 As shown in the , the certification process is expected to proceed using the pathway outlined below. There are 5 basic steps to get certified, which are submission, inventory and review, assessment, certification, announcement and award.
[0163] (A) General Authentication Process
[0164] (A.1) Step 1
[0165] The first step in granting certification is "submission". In order to reduce the workload of relevant laboratories and certification personnel, various documents need to be submitted together with STEM industrial products. The customer or manufacturer needs to explain which STEM attributes are covered and how the product will provide a learning experience. This provides guidance and direction for certification personnel to review and evaluate the said product. The operating method should also be submitted for reference so that no extra time is needed to understand how to use the product. These documents are intended to reduce the workload of laboratories and make the certification framework better adapt to the working procedures of certification bodies.
[0166] (A.2) Step 2
[0167] In the second step, "Checklist and Review", the reviewers will use and review the product / checklist based on the provided operating methods. They will then review the design, manufacture and evaluation (DMA) and integrated product development (IPD) of the STEM product. The reviewers will try to use the product and understand its characteristics. Since it is too time-consuming for testers to assemble the product during the certification process, for STEM products that require assembly, manufacturers should provide the assembled product together with the original product. This application is designed to be coordinated with the daily work of the testing laboratory. Manufacturers should also submit a description sheet to indicate the design education content of each STEM attribute so that reviewers can try only those specific parts. This is another measure to prevent additional workload for the laboratory.
[0168] (A.3) Step 3
[0169] The third step is "Evaluation". After trying and understanding the product, the tester will evaluate the ability to provide STEM education to students. Evaluations and scoring will be performed on STEM literacy, product features, and general capabilities. The tester will compare the actual experience with the description table to evaluate whether the stated educational content is effective and how the product provides the experience described in the description table. The effectiveness of the product in providing educational content will be the main evaluation point. The laboratory is mainly responsible for reviewing the product by cross-checking the product description and actual experience. This helps to minimize the time required to certify the product.
[0170] (A.4) Step 4
[0171] The fourth step is "certification". If the product is assessed to have passed all the requirements, it will be certified as a STEM industrial product. This means that the product is an effective STEM learning tool in both coverage and qualification level. This certification framework is not intended to increase the workload of laboratories. The cycle time to get a product certified is minimized and is expected to be similar to other certification frameworks. Therefore, time-consuming processes such as assembly work of the product and research on the educational value of the product need to be completed by the manufacturer.
[0172] (A.5) Step 5
[0173] The fifth step is "Announcement and Grant". The results will be announced to the customer. The customer will be authorized to display the legal right to use the certification mark on their products.
[0174] It should be noted that the inventors of this work have defined a detailed marking scheme for the three review categories in step 3: (1) STEM literacy, (2) product characteristics, and (3) general capabilities. In addition, the review of these three categories is consistent with the review in Section 2.2 ( Figure 8 ). The scores for each attribute described in the review categories were marked by the project team at the Hong Kong Polytechnic University (PolyU) based on user experience.
[0175] Steps 3 and 4 above are two key steps in STEM industrial product certification. The detailed description of the work required in Steps 3 and 4 is as follows:
[0176] (B) Detailed authentication process of step 3
[0177] (B.1) Step 3:
[0178] For step 3, some key steps are highlighted as follows: As described in Table 1, there are 3 possible scenarios for STEM industry products to consider. For scenario 1, the product has only hardware. For scenario 2, the product has only software. For scenario 3, the product has both hardware and software. The detailed score calculation and formula for each scenario are shown in Table 1.
[0179] Table 1. Score calculation for products in Scenario 1, Scenario 2, and Scenario 3.
[0180]
[0181]
[0182] Notes: (1) NA means not applicable; and (2) X1, X2, X3, X 2A , and X 2B is the normalized value.
[0183] This scoring formula is used to investigate the correlation between differences in product part identification and total score calculation through analysis of three different scenarios. Scenario 1 involves a product that contains only hardware components, while Scenario 2 involves a product that relies only on software. The characteristic of Scenario 3 is that the product consists of both hardware components and software components. The purpose of this analysis is to identify specific factors that contribute to the score calculation in each of these scenarios. Regardless of which scenario is considered. The calculation method for the total score of STEM literacy and general ability will remain unchanged. However, Scenario 1 is evaluated only based on hardware product characteristics, while Scenario 2 is evaluated only based on software product characteristics. In contrast, Scenario 3 takes into account the average of both hardware product characteristics and software product characteristics. In order to determine the total score for each scenario, the average score of STEM literacy, product characteristics and general ability is calculated.
[0184] (B.2) Step 3.1:
[0185] As in step 3.1 ( Figure 8 As shown in the figure 831, this is a step of evaluating and scoring the STEM literacy that can be acquired using the product. For (1) scientific literacy, (2) technological literacy, (3) engineering literacy, and (4) mathematical literacy, there are 12 potential application areas and 14 scoring criteria, 12 potential application areas and 20 scoring criteria, 12 potential application areas and 20 scoring criteria, and 26 potential application areas and 10 scoring criteria, respectively.
[0186] Fig. 9 An example of a product with a STEM literacy score is shown in sub-figure (a) of Fig. 9 As depicted in sub-diagram (b), the four elliptical Venn diagrams can be used to identify possible types of STEM products. For the relevant product example, it has all the required components (S, T, E, M).
[0187] (B.3) Step 3.2:
[0188] As in step 3.2 ( Figure 8 832), which is a step for evaluating and scoring the product characteristics that can be found in the product. After the design, manufacture and evaluation (DMA) and integrated product development (IPD) of the STEM product are reviewed, the STEM literacy after using the product will be evaluated and scored.
[0189] There are three scenarios to consider for product characteristics labeling schemes.
[0190] For scenario 1, it refers to a product with only hardware. For this scenario, the 14 evaluation categories of product characteristics can be specified accordingly based on the following categories: (1) ergonomics, (2) aesthetics, (3) functionality, (4) safety and reliability, (5) product price, (6) weight and size, (7) materials, (8) durability, (9) manufacturing quality, (10) strength and stability, (11) environmental characteristics, (12) resources / accessories, (13) regulatory compliance, and (14) maintenance and repair services.
[0191] For scenario 2, it refers to a product with only software. However, some basic hardware equipment systems must be used according to the user manual of the product. The hardware system is regarded as general equipment and the total score of the system is not evaluated. For this scenario, the 13 evaluation categories of product characteristics can be specified accordingly based on the following categories: (1) usability, (2) reliability, (3) compatibility, (4) portability, (5) testability, (6) scalability, (7) flexibility, (8) functional applicability, (9) maintainability and repair service, (10) interoperability, (11) performance efficiency, (12) product price, and (13) security.
[0192] For scenario 3, it refers to a product with both hardware and software. For this scenario, the product features have two total scores on hardware and software respectively. The scoring criteria for hardware and software can refer to the same procedures of scenario 1 and scenario 2 above accordingly.
[0193] Fig.10 Some description of product features is given. Fig.11 and Fig.12 Examples of product characteristic scores regarding a product (case 1: hardware only) and a product (case 2: software only) are shown respectively.
[0194] (B.3) Step 3.3:
[0195] As in step 3.3 ( Figure 8 As described in the reference numeral 833 of the figure, this is a step of evaluating and scoring the general abilities that can be learned after using the product. After reviewing the design, production and evaluation (DMA) and integrated product development (IPD) of the STEM product, the general abilities that can be learned after using the product will be evaluated and scored based on 21st century skills, such as Fig.13As described in the questionnaire, there are 9 scoring criteria for (1) critical thinking, 7 scoring criteria for (2) communication skills, 5 scoring criteria for (3) creativity, 6 scoring criteria for (4) collaboration, 7 scoring criteria for (5) problem solving, 6 scoring criteria for (6) data literacy, 8 scoring criteria for (7) digital literacy, 9 scoring criteria for (8) initiative, 7 scoring criteria for (9) curiosity, 5 scoring criteria for (10) perseverance, 6 scoring criteria for (11) adaptability, 12) leadership, and 6 scoring criteria for (13) social and cultural awareness, respectively. Fig.14 An example of general competency scores after using a STEM product is shown.
[0196] (C) Detailed authentication process of step 4
[0197] As in step 4 ( Figure 8 ), this is the step for certification. A STEM industry product (Scenario 1: Hardware only) is selected as an example for illustration.
[0198] (C.1) Step 4.1
[0199] As in step 4 ( Figure 8 ), which is described in the marking result ( Fig.15 An example is shown in Figure 2) and the steps for reviewing the report.
[0200] (C.2) Step 4.2
[0201] As in step 4.2 ( Figure 8 842), which is the step of making a final decision based on the information in step 4.1.
[0202] It is assumed that (1) STEM literacy, (2) product characteristics, and (3) general abilities are equally important for STEM industrial product certification.
[0203] The weighting factors for STEM literacy, product characteristics, and general capabilities are all set to 1.
[0204] Normalization:
[0205]
[0206] Total score:
[0207]
[0208] The simplified formula above, equation (2), is used to calculate the total score of STEM industrial products, where: X iare the scores of STEM literacy, product characteristics and general ability, i = 1, 2, 3; X(j) norm are the normalized scores of (1) STEM literacy, (2) product characteristics, and (3) general ability, j = 1, 2, 3; X max is the corresponding maximum value; X min is the corresponding minimum value; and Y is the total STEM product score expressed as a percentage.
[0209] (C.3) Step 4.2 Make a final decision based on the information in step 4.1
[0210] For the operation process of the example product, the following formula is obtained:
[0211]
[0212]
[0213]
[0214] as well as
[0215]
[0216] The formula detailed above is used to calculate the total score of the product in question, expressed as a percentage:
[0217] Total score:
[0218] (C.4) Step 4.3
[0219] As in step 4.3 ( Figure 8 843), which is the step of granting the product as a STEM industry product with a corresponding certification level (as described in Table 2).
[0220] Based on the total score Y calculated in Table 1, the total score expressed as a percentage is given by the formula (i.e. (total score ÷ 5) × 100%). By comparing the total score expressed as a percentage with the certification level in Table 2, the relative certification level of the product can be determined. Regarding product evaluation, any product with a score below 40% will be certified as having a poor quality level. Products with a score below 50% will be considered basic products, while scores below 60% will indicate an average quality level. Products with scores between 60% and 77% will be certified as good, while any product with a score above this threshold will be considered excellent.
[0221] (D) STEM industrial product certification level
[0222] The total score expressed as a percentage, certification level, and certification status for STEM industrial products (Scenario 1: Hardware only) are described below:
[0223] Y=80%
[0224] The certification level was found to be 5 (Excellent).
[0225] The star rating is described as ★★★★.
[0226] Table 2. Conversion table of total score (expressed as a percentage), certification level, star rating, and description of STEM industry products.
[0227]
[0228] Another example of the total score and certification level of a product in Scenario 3: A product having both hardware and software is described as follows.
[0229] The product's total score and certification level:
[0230] The product was evaluated based on three review categories: STEM literacy, product features (hardware + software), and general capabilities. After analyzing each category, it was found that this product was rated as excellent in STEM literacy, product feature performance, and general capability effectiveness. As indicated in Table 3, based on a total score expressed as a percentage of approximately 84%, this product was classified as excellent in terms of certification level.
[0231] Table 3. Detailed score evaluation.
[0232]
[0233] References
[0234] The following is a list of references occasionally cited in this specification. The disclosures in each of these references are incorporated herein by reference in their entirety.
[0235] [1] White, S., and David, J. “What is STEM education and why it matters,” Journal of the Florida Association of Teacher Educators, vol. 1, no. 14, pp. 1–9, 2014.
[0236] [2] EJ Hom, “What is STEM education?” Live Science Contributor [Online], http: / / www.livescience.com / 43296-what-is-stem-education.html , June 27, 2021.
[0237] [3] Y. Li, A. Schoenfeld, A. diSessa, A. Graesser, L. Benson, L. English, and R. Duschl, “On Thinking and STEM Education,” Journal of STEM Education Research, vol. 2, no. 1, pp. 1–13, 2019.
[0238] [4] Manosuttirit and Artnarong, “How to apply technology in STEM education courses through project-based learning,” pp. 012044.
[0239] [5] Lazarides, Rebecca, Lauermann, and Fani, “Gendered pathways into STEM-related and language-related careers: Girls’ and boys’ motivational beliefs and career plans in mathematics and language arts,” Frontiers in Psychology, vol. 10, pp. 1243–1244, 2019.
[0240] [6] Holmes, Kathryn, Gore, Jennifer, Smith, Max, Lloyd, Adam, “An integrated analysis of students’ STEM career aspirations across schools: Which student and school factors are most predictive?” International Journal of Science and Mathematics Education, Vol. 16, No. 4, pp. 655–675, 2018.
[0241] [7] National Science Board, “A National Action Plan to Address Critical Needs in the Nation’s Science, Technology, Engineering, and Mathematics Education System,” National Science Foundation, 2007.
[0242] [8] Noonan, Ryan, and U.S. Department of Commerce, “STEM Employment: 2017 Update.” ESA Issue Brief #02-17, 2017.
[0243] [9] European Central Bank, “Potential Output Trends”, p. 13, 2011.
[0244]
[10] Barcelona, Kimberly, and American Educational Research Journal, “21st Century Curriculum Reform Initiative: Focusing on STEM Education as an Integrated Approach to Teaching and Learning,” Vol. 2, No. 10, pp. 862-875, 2014.
[0245]
[11] Encyclopædia Britannica and T. Ed. Encyclopædia Britannica, “Producer Goods”, Encyclopædia Britannica, 2021.
[0246]
[12] K. AMADEO, “What are capital goods?”, [July 17, 2021, 2021], https: / / www.thebalance.com / capital-goods-examples-effect-on-economy-3306224.
[0247]
[13] S. Ross, “Capital and consumer goods: what is the difference?” https: / / www.investopedia.com / ask / answers / 032515 / what-difference-between-capital-good-and-consumer- good.asp ,[July 17,2021,2019].
[0248]
[14] Kurian and G. Thomas, eds., AMA Dictionary of Business and Management, [Enhanced Creed Edition], New York: American Management Association, 2013.
[0249]
[15] N. Hashimzade, G. Myles, and J. Black, The Oxford Dictionary of Economics, Oxford: Oxford University Press, 2017.
[0250]
[16] Kolb, R. W., The SAGE Encyclopedia of Business Ethics and Society, Oak Oaks: SAGE Press, 2018.
[0251]
[17] P.BOYCE, “Consumer Goods Definition (6 Examples and 4 Types)”, https: / / boycewire.com / consumer-goods-definition-types-and-examples / , [July 17, 2021, 2021].
[0252]
[18] N. Tsupros, R. Kohler, and J. Hallinen, “STEM education: A project to identify the missing pieces,” Intermediate Unit, vol. 1, pp. 11–17, 2009.
[0253]
[19] K. Farla, “Joint-STEM-lab-facility,” https: / / www.technopolis-group.com / wp-content / uploads / 2020 / 02 / Joint-STEM-lab-facility.pdf, 2019.
[0254]
[20] Anderson, Judy, and Y. Li, “Integrated Approaches to STEM Education: An International Perspective,” Cham: Cham: Springer International Publishing AG, 2021.
[0255]
[21] Y. Li, A. H. Choenfeld, A. C. Graesser, L. C. Benson, L. D. English, and R. A. Duschl, “On Thinking and STEM Education,” Springer-Verlag, 2019.
[0256]
[22] N. A. Zaki, N. Z. Zain, N. Z. Noor, and H. Hashim, “Developing a conceptual model for learning analytics in serious games for STEM education,” Journal of the Indonesian Academy of Education, vol. 9, no. 3, pp. 330-339, 2020.
[0257]
[23] K.C. Margot, and T. Kettler, “Teachers’ Perceptions of STEM Integration and Education: A Systematic Literature Review,” International Journal of STEM Education, vol. 6, no. 1, pp. 1–16, 2019.
[0258]
[24] MG Bertrand, and IK Namukasa, “STEAM education: student learning and transferable skills,” Journal of Innovative Teaching Research, vol. 13, no. 1, pp. 43–56, 2020.
[0259]
[25] G. Strimel and ME Grubbs, “Positioning technology and engineering education as a critical force in STEM education,” Journal of Technology and Education, vol. 27, no. 2, pp. 21–36, 2016.
[0260]
[26] SJ Lynch, T. Behrend, EP Burton, and B. Means, “Inclusive STEM-focused high schools: STEM education policy and opportunity structures.”
[0261]
[27] A. Y. U. Reche, O. C. Junior, C. C. A. Estorilio, and M. Rudek, “Integrating product development processes and green supply chain management: Contributions, limitations, and applications,” Journal of Cleaner Production, vol. 249, pp. 119–429, 2020.
[0262]
[28] C.-C. Huang, “An overview of modular product development,” Proceedings of the National Science Board: Physical Sciences and Engineering, Vol. 24, No. 3, pp. 149–165, 2000.
[0263]
[29] J. Clarke-Midura, V. R. Lee, J. F. Shumway, and M. M. Hamilton, “Building blocks of coding: A comparison of coding toys for young children,” Information and Learning Sciences, 2019.
[0264]
[30] Z. Zhao, “Research on STEM Education in American Primary and Secondary Schools”, pp. 140-147, Shanghai: Shanghai Science and Technology Education Press, 2017.
[0265]
[31] MD Kembara, RWA Rozak, and VA Hadian, “Foundational Lectures to Improve Students’ 4C (Communication, Collaboration, Critical Thinking, and Creativity) Skills,” pp. 22–26.
[0266]
[32] J. Pumphrey and J. Slater, “Assessment of general skills needs”: DfES, 2002.
[0267]
[33] A. F. Sommer, I. Dukovska-Popovska, and K. Steger-Jensen, “Barriers to integrated product development – Challenges from a holistic project management perspective,” International Journal of Project Management, vol. 32, no. 6, pp. 970–982, 2014.
[0268]
[34] D. Gerwin and N. J. Barrowman, “An evaluation of integrated product development research,” Management Science, vol. 48, no. 7, pp. 938–953, 2002.
[0269]
[35] Npd Solutions. “Implementing an Integrated Product Development Practice: Lessons Learned,” March 23, 2022; https: / / www.npd-solutions.com / implementing.html.
[0270]
[36] Thomas alspaugh. “Types of Software Quality”, https: / / www.thomasalspaugh.org / pub / fnd / ility.html.
[0271]
[37] J.B. Goodenough, “Evaluating the Impact of Software on Systems and System Reliability,” Software Engineering Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania, 2010.
[0272]
[38] LLC. “Principles of Integrated Product Development,” https: / / simple-pdh.com / principles-of-integrated-product-development / .
[0273]
[39] S. Vajna, Integrated Design Engineering: Interdisciplinary and Holistic Product Development: Springer Nature, 2020.
Claims
1. A method for certifying a product in the science, technology, engineering and mathematics (STEM) industry, the method comprising: Assessing and scoring the level of STEM literacy that can be obtained by using the product (831), thereby obtaining a first score on STEM literacy; evaluating and scoring product characteristics that can be found in the product (832), thereby obtaining a second score for the product characteristics; evaluating and scoring the general abilities that can be learned after using the product (833), thereby obtaining a third score on the general abilities; making (842) a final determination on the total score of the product based on the first score, the second score, and the third score; as well as A certification level is awarded (843) to the product based on the product's total score.
2. The method of claim 1, wherein the product is hardware only, and wherein the evaluating and scoring of product characteristics comprises: The products were evaluated in the following categories: ergonomics; aesthetics; functionality; safety and reliability; product price; Weight and dimensions; materials; Durability; Manufacturing quality; strength and stability; environmental characteristics; resources or accessories; regulatory compliance; and maintenance and repair services; which earned the second score.
3. The method of claim 1, wherein the product is software only, and wherein the evaluating and scoring of product characteristics comprises: The products were evaluated in the following review categories: usability; reliability; compatibility; portability; testability; Scalability; flexibility; functional applicability; maintainability and repair services; interoperability; performance efficiency; product price; and security; thus obtaining the second score.
4. The method of claim 1 , wherein the product has hardware components and software components, and wherein the evaluating and scoring of product characteristics comprises: The hardware components were evaluated in the following review categories: ergonomics; aesthetics; functionality; safety and reliability; product price; weight and size; materials; durability; manufacturing quality; strength and stability; environmental characteristics; resources or accessories; regulatory compliance; and maintenance and repair services; thereby obtaining a fourth score for product characteristics related to the hardware component; The software components are evaluated in the following review categories: usability; reliability; compatibility; portability; testability; scalability; flexibility; functional suitability; maintainability and repair services; interoperability; performance efficiency; Product price; and security; thereby obtaining a fifth score of product characteristics associated with said software component; as well as The second score is obtained by averaging the fourth score and the fifth score.
5. The method according to claim 1, wherein the general capabilities include: Critical thinking; Communication skills; Creativity; cooperation; Problem Solving;Data Literacy; Digital literacy; Initiative; curiosity; Perseverance ability; Adaptability; leadership skills; and social and cultural awareness.
6. The method according to any one of claims 1 to 5, wherein the total product score is calculated as a weighted average of the first score, the second score and the third score. 7 . The method of claim 6 , wherein in calculating the total score, the respective weighting factors of the first score, the second score, and the third score are unified.
8. The method of claim 7, wherein making a final decision on the total score comprises: Normalizing the first score, the second score, and the third score to obtain normalized scores of STEM literacy, product characteristics, and general ability, respectively; as well as The total score is calculated by averaging the normalized scores for STEM literacy, product characteristics, and general capabilities.
9. The method of claim 8, wherein the normalized scores of STEM literacy, product characteristics, and general capabilities are obtained by i=1,2,3, And the total score is obtained by Calculated, in: X1 is the first score; X2 is the second score; X3 is the third score; X(1) norm is the normalized score of said STEM literacy; X(2) norm is the normalized score of the product characteristic; X(3) norm is the normalized score of the general ability; X max is the corresponding maximum value; X min is the corresponding minimum value; and Y is the total score expressed as a percentage.
10. The method of claim 9, wherein granting the product a certification level according to the total score of the product comprises: When 77%≤Y≤100%, the certification level is determined to be 5, which is used to describe that the product quality has reached an excellent level; When 60%≤Y<77%, the certification level is determined to be 4, which is used to describe that the product quality reaches a good level; When 50%≤Y<60%, the certification level is determined to be 3, which is used to describe that the product quality reaches the average level; When 40%≤Y<50%, the certification level is determined to be 2, which is used to describe that the product quality reaches the basic level; as well as When 0%≤Y<40%, the certification level is determined to be 1, which is used to describe that the product quality has reached a poor level and does not meet the quality standards.
