Validity and Reliability of a Novel AI-Based System in Athletic Performance Assessment: The Case of DeepSport †

This study aimed to examine the validity and reliability of the AI-based DeepSport application by comparing its outcomes with those from the reference device, OptoJump. The primary dependent variables measured were jump height and anaerobic power during vertical jump assessments. Twelve elite male basketball players voluntarily participated in the study (age = 21.53 ± 1.14 years; sports experience = 6.47 ± 1.01 years). DeepSport uses AI-based image processing from standard cameras, while OptoJump uses optical sensor technology. Both DeepSport and OptoJump systems were utilized to assess participants’ Countermovement Jump (CMJ) and Squat Jump (SJ) performances. A G*Power (version 3.1.9.7) analysis determined the required sample size, adopting a 95% confidence level, 90% test power, and an effect size of 0.25. Validity assessments were conducted using Bland-Altman plots and ordinary least products (OLP) regression analysis, while reliability was evaluated through intraclass correlation coefficient (ICC), coefficient of variation (CV), standard error of measurement (SEM), and smallest detectable change (SDC) analyses. DeepSport showed excellent reliability in CMJ and SJ tests with ICC values > 0.90, and CV ranged between 2.12% and 4.95%. Results were consistent with OptoJump, showing no significant differences according to t-test results (p > 0.05). Bland–Altman analyses indicated no systematic bias and random distribution. These findings confirm that both DeepSport and OptoJump devices demonstrate high reliability and consistency, suggesting their validity and reliability for use in athlete performance assessments by coaches and athletes.