Sürdürülebilir Kalkınma Amaçları
Yazarlar
Yayınlar
- MakaleAçık Erişim2026Statistical and qualitative analysis of ChatGPT and human raters in preservice teachers' writing assessment
Gülden, Bahadir; Bilge, Huzeyfe; Uysal, Pinar Kanik
Teachers spend a significant amount of time providing feedback. This study compared expert and ChatGPT assessments and feedback on written texts to determine the suitability of AI for writing skill assessments that are time-consuming to assess and provide feedback. Three experts and ChatGPT graded 14 Turkish undergraduate students' assignments using rubric that included content, language use, vocabulary, organization, and mechanics, and justified their decisions. The study involved document review and triangulation, a qualitative design. In addition, an intraclass correlation coefficient was used to assess the consistency of the ChatGPT and the experts' scores. All feedback was qualitatively analyzed to identify the strengths and weaknesses of the experts and their similarities with ChatGPT. Experts and ChatGPT had moderate to weak consistency in the writing subscales, while good reliability was found in the total score. Experts excelled in 'explanatory feedback', 'interpretation' and 'experience', while ChatGPT excelled in 'automation and continuity' and 'data processing capacity'. Experts' weaknesses included 'limited time and energy' and 'comparison bias', while ChatGPT's weaknesses were 'ambiguous expressions' and 'repetition'. The study also found that experts and ChatGPT preferred to provide constructive and supportive feedback.
AtıfWoS1OpenAlex2
İncele - MakaleYayıncıda açık erişim2025Answer-based and reference-based BERT models for automatic scoring of Turkish short answers: The decisive role of task complexity
Kara, Abdulkadir; Kara, Zeynep Avinc; Yildirim, Serkan
In measurement and evaluation processes, natural language responses are often avoided due to time, workload, and reliability concerns. However, the increasing popularity of automatic short-answer grading studies for natural language responses means such answers can now be measured more quickly and reliably. This study aims to build models for predicting automatic short answer scores using the pre-trained BERT deep learning language model and to reveal their effectiveness. For this purpose, two different score prediction models were created using an answerbased approach that aligns student answers with expert judgements and a referencebased approach that matches student answers with reference answers. The dataset includes answers from 246 Physics department students responding to 4 physicsrelated questions. The performance of these models was evaluated on four physics questions representing varying levels of cognitive complexity, using Cohen's Kappa for statistical comparison of agreement with expert scores. Our findings reveal a clear interaction between model architecture and task complexity. The answer-based model was unequivocally superior for the most complex, multi-class task, effectively capturing diverse, nuanced responses. Conversely, the reference-based model demonstrated a statistically significant advantage for a well-defined, mediumcomplexity binary task. This study concludes that the optimal model for ASAG in Turkish is contingent on the cognitive demands of the assessment task, suggesting that a onesize-fits-all solution may not be the most effective approach. This provides a critical framework for practitioners, demonstrating not only that effective models are feasible for complex languages, but that their selection must be guided by task complexity.
AtıfWoS1OpenAlex2İncele - MakaleAçık Erişim2025The interplay between university students' needs, maturity levels (personal, familial, and social), and life satisfaction
Akyüz, Ahmet Mutlu; Durmus, Ibrahim
It is essential for young Turkish individuals (university students) to rapidly develop their skills and abilities to take on leadership roles in society. To become well-equipped individuals who contribute to societal welfare and development, these young adults must undergo a healthy adolescent maturity process. Therefore, providing a supportive environment for Turkish adolescents during their maturation is crucial. This study investigates how fulfilling all hierarchical needs (PSN, LBN, ESAN) affects Turkish adolescents' life satisfaction (LS) and their personal (PM), familial (FM), and social (SM) maturity levels. The study sample consists of 397 Turkish university students. The proposed research model was tested using PLS-SEM analysis. The findings indicate that fulfilling all hierarchical needs positively affects life satisfaction. Additionally, life satisfaction serves as a mediator between the fulfillment of hierarchical needs and maturity levels. However, the most fundamental physical and security needs are not adequately met, hindering personal maturity. Furthermore, love and belonging needs and esteem and self-actualization needs positively impact all maturity levels.
- MakaleAçık Erişim2023Development of self-regulation scale for middle school students: Validity and reliability study
Sarikaya, Ismail; Ozturk, Mesut; Ozgol, Mustafa
This study was conducted to develop a valid and reliable measurement tool that can identify middle school students' self-regulation skills. Firstly, the literature was utilized in the development of the measurement tool. The form was finalized with the support of the opinions of different experts and a trial application. Then, the form was administered to 341 middle school students to determine its construct validity, and exploratory factor analysis (EFA) was performed on the collected data. Then, the form was administered to 341 middle school students to determine its construct validity, and exploratory factor analysis (EFA) was performed on the collected data. As a result of the study, it was determined that the scale consisted of 9 items and two sub-dimensions, namely forethought and volitional control and self-reflection. In order to reveal the reliability of the scale, internal consistency, two-half test analyses, and composite reliability (CR) were used, and it was determined that the values found were .74 and above. In order to reveal the accuracy of the obtained structure, data were collected from 218 middle school students in a different province, and confirmatory factor analysis (CFA) was performed with these data. As a result of the analysis, the two-factor structure of the scale was confirmed. When the findings are examined, it can be said that the scale is a reliable and valid tool that can be applied to determine the self-regulation skills of students studying at the middle school level.
AtıfWoS1OpenAlex4TR Dizin2İncele - DergiINTERNATIONAL JOURNAL OF ASSESSMENT TOOLS IN EDUCATION