Adaptive Learning Instruments
Temenoujka Fuller* and Galina Krumova**
*Central Arizona College, USA, **University of Rousse, Bulgaria
Abstract: This paper presents the structure and dynamics of the learning process for a group of 51 community college students. A time series data about students learning is collected in a specialized learning center. Students' learning preferences are measured with a learning orientation survey. The fine structure and dynamics of students' learning preferences are presented as a 3D map. On the basis of this map, patterns of behavior are identified and used to inform the development of adaptive learning instruments.
Key words: Learning Theory, Synergy, Assessment Instruments, Need Analysis, Learning Demand, Learning Orientation
In traditional educational, students' learning needs are usually identified by pre/post tests for each learning units. Usually, the psychological characteristics of the students are not taken into consideration. Knowing the exact distribution of students' learning preferences is important for sequencing the material online, which is something that good teachers do intuitively. In short term, students follow the requirements of the instructor and their learning needs remain hidden. For any group of students, depending on how they feel about learning, the learning needs are not a frozen homogeneous state throughout the semester. Students' needs of learning support have complex fluctuations which vary from student to student, and for each individual student the learning needs depend on the time. In this paper, the cognitive characteristic of students is considered fixed, student achievement on standardized test is used to select the sample of students. Students' personalities and learning behavior are used for forecasting the fluctuations of students' needs of learning support. The psychological characteristics and time-distribution of students' independent learning for the case of a cognitively homogeneous group of 51 community college students is presented in this paper as a 3D map. The map is used for developing a procedure for forecasting of students behavior and suggestions of effective and efficient design of learning activities at specific weeks of the semester.
Two concepts are used in the study: the concept of students’ learning demand [7, 3] and the concept of students’ learning orientations .
The concept of students' learning demand has different interpretations for a course or fine sequencing of material by the instructor in a traditional classroom  and for learning demand related to co-curricular services . The learning demand, as it is defined in this study, is about students' free and independent learning outside of the classroom. Students' learning is a multi-component process which includes students' personality, motivation and desire to utilize the existing learning services, teaching methods and assessment instruments. This paper presents students learning as it depends on the distribution of students' personality and learning services. For each set of learning services, the distribution of the day of visits versus time invested by the learners in a learning center will provide an objective measure of the learning demand. The time and day of students’ visits are observable and measurable information on the type of learning support which students recognize as important for them. The two dimensional time-dependence (day and duration) of student learning behavior with respect to existing learning services of a community college is used as a measure of the learning demand.
The second concept of the study is the concept of students’ learning orientations. This concept is used to reveal how student’ feelings and actions toward learning services reflect the group's learning behavior. According to Martinez , the key question to students' feelings and instinctive actions about learning depend on students' feeling about the ability of instructor to provide opportunities for learning with effective support . Therefore, the assessment of students' Learning Orientations (Copyright © 1997-2001, Margaret Martinez) is used to identify students’ inborn or trained learning feelings and learning actions . There are five major categories of students' learning orientations according to Martinez : transforming, high performing, low performing, conforming, and resistant . Transforming students are independent learners, performing students are semi-dependent, and conforming students need a step-by-step guidance. In this study, the differences between students' learning orientations are taken with the values measured by the survey, which are between 2 to 7, for mapping the usage of learning services as they depend on students' learning orientation.
One of the goals of this study is to develop a research-based methodology for appropriate design of learning units online that will direct the learning process of a group of students. The research about adaptive learning instruments online requires measurements on the learning demand independent of the classroom instruction. Assessment instruments online serve both cognitive and learning purposes. Adaptive supplement for assessment and guidance of students' learning are considered and briefly discussed in the paper. In the future, adaptive learning instruments and constant tracking of students' learning online will allow balance between learning challenges (assessments) and students' skills. According to Massimini and Carli , students' feelings about learning process depend on the ratio of their skills and the challenges of the curriculum.
Using time series analysis  of students learning, this paper describes and visualizes students' non-supervised learning behavior, which is very similar to information that is easily obtainable in online classes. A visual map of students’ personality profile versus the use of learning services for the first 7 weeks of the semester is used to forecast the learning needs for the rest of the semester, and to guide the adaptation of curriculum to students' learning process. Some experiments with learning environments designed to provide positive experiences and different opportunities for diverse learning population observed in this study are described and discussed in the light of results of the study combined with related research [1, 9].
Population: The target population consists of adult students enrolled in developmental classes in a community college. All students involved in the study are low achieving on standardized placement tests, therefore the cognitive characteristics of the group are not taken into consideration. The personality profile and learning demand are studied with 51 community college students. The same 51 students are observed in a learning center for the first seven weeks of the spring semester 2003.
Knowledge of learning differences between community college students' and students enrolled in undergraduate classes in the university is used as a guide for decision-making in selecting assessment instruments for the undergraduate university students in the University of Rousse, Bulgaria.
Method: Time series data  include 50 days, 15 hours a day observations of the time invested by the students in a learning center. Weekends are not included in the study.
The sampling procedure was stratified and blind. The participants had no knowledge that they participated in a larger study on students’ learning demand. Next, all students - those selected to participate in the study and those who were not selected to participate in the study - had equal opportunity to use learning services. The learning center provided tutoring and other learning services with the open-door policy for all visitors; each student enrolled in developmental classes had equal right to visit the center for assistance by tutors or for co-curricular learning services. Therefore, all combinations of visits were possible. This was a unique opportunity to collect information of randomly occurring sub-samples of the group of 51 students every day.
Time data collection of students’ visits was administered by the front desk check-in and check-out registration. The data were used to trace the date and duration of each individual visit. The day and duration of students' visits were used as independent and dependent variables (Table 1). The distribution of students' learning preferences is measured by the Learning Orientations Questionnaire (Copyright © 1997-2001, M. Martinez). The best sequencing for each student  depends on student's learning orientations.
The series-time data collected in the learning center were plotted together with the data on students’ learning preferences and used to visualize the learning behavior by a contour map. The program Surfer (Golden Graphic Software) was used to map the 3D distribution of time versus learning preferences.
The variables of the study are presented in Table 1. Two independent variables and one dependent variable were used for visualization of students’ choice to utilize learning services during the first 7 weeks of the semester .
Table 1: Dependent and independent variables used in the study
Results: Need analysis assess through time data collection and visualization was successfully used in the study to inform the design of instruction. The learning time series analysis should be an ongoing procedure for online classes aimed to assess and forecast patterns of learning behavior. Having the forecast, the developer of instruction could select the right method for building learning environments adaptive to students learning needs.
The distribution of time, invested by the students during the first seven weeks of the semester, was used as a time series data . Learning time, invested by the students to study in a learning center, depended on curricular and teaching methods. The study can not be generalized outside of the selected students; however, the method for forecasting students’ learning behavior could be used for any group of students. The data on students’ free visits to the learning center is used in the study as a measure of students’ free will to utilize supportive learning services outside of the classroom.
The Learning Orientation Questionnaire developed by Martinez  showed that the majority of the students were performing or practical type of learners. Performing students prefer manageable tasks, well structured with enough time for completing the tasks without stress. Transforming students wanted more global and challenging tasks. The survey measured only two out of 51 cases of transforming or global learners who could learn independently. Conforming students preferred small challenges, fine sequencing of the material and constant guidance. To observe students’ learning needs as they depend on individual learning orientations, educators will benefit from educational research embedded into the Learning Management Systems, such as BlackBoard, MOODLE, WebCT, and such.
The summary of the raw data about students’ learning orientation is presented in the first column of Table 2. Column 2 presents the rank of students' learning orientations. Columns 3 and 4 present the distribution of students with different learning orientations measured in the study.
Table 2: Results of the learning orientation survey conducted with fifty-one community college students (Copyright © 1997-2001, M. Martinez)
For statistical analysis, the exact score for each individual student is subtracted from the average for the group. The deviations of students' learning orientations are indicated by positive values if they are above the average for the group, and with negative values if they are below it (the Oy axis of Fig. 1). The results of the study on students’ learning demand are displayed by two variables: x and z. The horizontal axis (Ox) presents the day of students' visits. The axis Oz presents the time of each individual visit. This time is cartographically displayed on the contour map. The learning demand is the distribution of time invested by the students to study in the learning center as it depends on the day of the semester (x) and the learning orientation of the student (y).
The results of the data-visualization presented in Fig. 1  are compared with respect to the distribution of patterns of behavior in Table 3 . At the beginning of the semester, the learning demand is considered pro-active. Students with learning orientations high above the average (transforming or global learners) are the most frequent users during the first half of the period of observation. However, the same students use the services less than one hour (under the zero level) during the second half of the period. The conclusion is that the group of independent learners has been less interested in the learning services after the first three weeks than at the beginning of the semester. This is an indication that the developers of instruction need special adaptive to these group learning activities to engage the students with high learning orientation in the period in which they are becoming more apathetic, which is after week 3 or 4 semester in the case of this study. For different group of students, similar analysis may indicate different peaks and These assessments will help the high performing students who are also passive during the second half of the period of this study.
The group of conforming, or highly dependent students, will benefit from more structure at the beginning of the semester to avoid the "fear-of-failure" before the midterm. Also, the group of high performing students (above the average, but under the high transforming) will need motivation through the entire period. These students are capable and it is evident that they are not using the learning services.
For a better visualization, the duration of students' visits are divided into two groups, visualized as above the "see level" and below the "zero or sea level". Above the "sea level" with different white/gray colors are presented the areas where the demand is more than one hour; in the dark gray areas (under the "sea") the learning demand is less than one hour. On the map, the duration of students' visits is displayed with closed contours by software program "Surfer" (Golden Graphics). The contour map presents peak hours of students' visits as mountains, and the time with fewer students' visits as an ocean. The distribution of students' learning demand as it depends on the date of the semester and students' personalities has complex “land-shaft.” The whiter areas are the so called peaks in learning demand. It is interesting that the white areas indicates absolutely solid high demand during the midterm at the end of the period of observation, which is an indication that the assessment instruments are an effective method for engagement of student in active learning.
Fig. 1: The map of students' learning demand  versus students' learning orientations measured by a Learning Orientation survey  (Courtesy of Dr. Martinez, 2003)
The components on the time series data as they appear on the map (Fig.1) are:
The analysis of the differences during the semester (in horizontal direction) shows two big hills - named "hope for success" and "fear of failure”. These two peaks are indication for developers of instruction to use multipurpose assessment instruments to address different learning needs. Although the peak denoted on Fig. 1 as “hope for success” shows learning enthusiasm, it is a short-term enthusiasm. Global thinkers are very active at the beginning and later on usually compensate the lack of interest in tedious educational procedures with smart ideas and attempts to start new projects constantly. The goal of educators is to help those students to become more detail oriented. If educators and instructional developers have on a timely manner maps of students behavior, they will be able to adaptively react to keep high enthusiasm and engagement. The example presented in this paper can be used for online monitoring of students behavior. The taxonomy of students' feelings  could be used for keeping students natural desire to learn. Table 3 presents what happened if there is no balance between assessments or the complexity of learning units and student readiness to learn. In old system, the lack of balance between skills and challenges was difficult for a group of students; this is why the traditional face to face education is beneficial in small groups. In online class, having an opportunity for a constant monitoring of students' learning, the balance between challenge and skills can and should be considered. To avoid the effect described in Table 3, the educators of the future will need to provide adaptive learning services.
Table 3: Students' learning experiences as they depend of the ratio between students' skills and learning challenges
Applications: The results of the study are used for adapting the curriculum to the patterns of behavior of students' self-directed learning. How to use assessment instruments to guide students away from fear and anxiety towards hope-for-success depends on the instructor or developer of learning supplements. Do the students with learning orientations above the average level have a natural "hope-of-success" attitude? Can the instructional designer select the most beneficial assessment instruments to lead students away from fear toward success by constant monitoring of the patterns of behavior in the group? To answer these questions, the authors experimented with different assessment instruments (presented in Table 4) to meet students' learning needs in different weeks of the semester.
Table 4: Research-based decisions on the appropriate learning devices for self-directed guide to improve the positivistic learning
In Phase I (Fig. 1), the strategic goal for conforming students should be to reach a certain level of relaxation (cell 33, Table 3). A future instructional designer will need an effective strategy to break the so-called "fear-of-failure" peak in phase III into manageable for the students sequences of learning units. For this purpose, following the research-based guideline, Fuller and Krumova  developed a reading guide online for community college and university students enrolled in science classes. Students reported high satisfaction of the reading guides. To avoid some negative consequences of open-book assessment, such as figuring or locating the answers without any learning, the instructor could assign note-taking for the new lesson as a graded assignment.
In phase II, along with the regular note-taking techniques, the instructor could add mind- or concept-mapping for the new lesson as an assessment instrument. The mind-mapping is a meta-cognitive procedure that will help students to make sense of the new material and to sharpen their attention and effort in the direction of their personal challenges . The purpose of a mind-mapping learning units is to create a personalized and self-directed opportunity for students to learn with more freedom and creativity. Mind mapping may be used as an adaptive assessment instrument.
During the second and the third phase, transforming students also will benefit from more creative assessment instruments, such as Power Point presentations. This will fill the gap between the initial learning enthusiasm and the low activity in the interval between week three to week seven for all transforming students. To engage high performing and transforming learners in the flow (cell 13, Table 3) sophisticated workshops with a guest speaker may provide some impulse in the right direction. The artistic elements of student-teaching in front of the class could be used to create a united force in the direction of the flow in which the high skills are balanced by high challenges. For example, a program for nuclear physics class, developed by Krumova and Fuller , was applied successfully for university students after the second week.
Conclusion: To increase the synergy between individuals and the educational institution, the educators need to consider the fine structure of students' natural learning preferences, feelings, and learning intentions throughout the semester. Although students have different learning preferences, the patterns of behavior during the first few weeks of the semester will provide research-based information for selecting the best assessment instruments as learning devices online.
 Csikszentmihaly, M.; Finding Flow: The psychology of Engagement with everyday life, New York, HarperCollins Publishers, Inc., 1997, pp 17 – 31
 Douglas, D. and Clark, J.; Business Statistics, Fourth Edition, Barron’s Educational Series Inc., Hauppauge, NY, USA, 2003, pp. 419-449
 Fuller, T.; Students' Learning Demand, 2005,
 Fuller, T. and G. Krumova; Online Reading Supplements for Atomic and Nuclear Physics Chapters of a General Chemistry Course, In: Proceedings of the Scientific Conference with International Participation, Technical University of Varna, Oct 7-9, 2004, Varna, Bulgaria, Vol. 3, 2004, pp. 653-659
 Jones, E. R. and M. Martinez; Learning Orientations in University Web-Based Courses - a paper accepted for publication in the Proceedings of Web Net, Orlando, Florida, 2001, Oct 23-27, 2003, URL: http://www.tamucc.edu/~ejones/papers/webnet01.pdf
 Krumova, G. and T. Fuller; Some Problems in Atomic and Nuclear Physics Education, In: Proceedings of the Scientific Conference with International Participation, Technical University of Varna, Oct 7-9, 2004, Varna, Bulgaria, Vol. 3, 2004, pp. 645-652
 Leach, J. and P. Scott; Designing and Evaluating Science Teaching Sequencing: An Approach Drawing upon the Concept of Learning Demand and a Social Constructivist. Perspective on Learning. Studies in Science Education, 38, 2002, pp. 115-142
 Martinez, M., Key; Design Considerations for Personalized Learning on the Web, Educational Technology & Society 4(1), 2001,
 Massimini, F., and M. Carli; Systematic Assessment of Flow in Daily Experience, 1988. In: Csikszentmihaly, M.; Finding Flow: The Psychology of Engagement with Everyday Life, New York, HarperCollins Publishers, Inc., 1997, p. 31
 Ramsden, P.; Student learning and perceptions of the academic environment, Humanities, Social Sciences and Law, Vol. 8, 4, 1979, pp 411-427,
АДАПТИВНИ УЧЕБНИ ИНСТРУМЕНТИ
T. Фулър*, Г. Крумова**
*Central Arizona College, USA, **Русенски университет
Резюме: Тази работа представя структурата и динамиката на студентското учене за група от петдесет и един студенти от един колеж в САЩ. В специализиран учебен център е събрана времева серия от данни. Учебните предпочитания на студентите са оценени с помощта на анкета за учебната ориентация. Фината структура и динамика са представени с 3D карта, на базата на която са идентифицирани области на поведение, използвани за развитието на адаптивни учебни инструменти.