Does AI Assistance Leave a Temporal Fingerprint? Detecting Overreliance in AI-Assisted Writing and Programming

Open Access
Article
Conference Proceedings
Authors: Eduardo Davalos, Yike Zhang
Abstract

The rapid adoption of generative AI has made final artifacts unreliable evidence of student learning, and AI detectors that examine only the finished product are inaccurate and ethically contentious. Process data offers an alternative, but prior work covers only English essay writing. We ask whether AI assistance carries a temporal signature, whether it generalizes from writing to programming, and whether it distinguishes ordinary collaboration from wholesale delegation. We analyze three public corpora: CoAuthor (1,447 keystroke-level co-writing sessions), RealHumanEval (editor telemetry from 243 programmer records), and a pre-LLM CS1 corpus (5.1 million keystrokes) as a human-only baseline, comparing minimal-AI work, collaborative AI use, and simulated wholesale delegation. Three findings emerge. First, the signature generalizes: AI contributions arrive in bursts far outside the author's own baseline in both mediums (paired d_z = 1.13 and 3.54). Second, engagement diverges by medium: 93% of AI-inserted characters survived to writers' final documents, while only 14% of accepted code suggestions survived intact. Third, classifiers using only observable temporal features separate simulated delegation from authentic work nearly perfectly (F1 ≥ 0.997; at most 0.5% of real work misclassified), while ordinary collaboration remains hard to distinguish from unassisted work. Temporal evidence flags wholesale delegation rather than assistance, positioning process visibility as a candidate evidentiary basis for academic integrity, pending validation in authentic coursework.

Keywords: AI in Education, Academic Integrity, AI Overreliance, Keystroke Logging, Learning Analytics, AI-Assisted, Cognitive Offloading

DOI: 10.54941/ahfe1008353

Cite this paper
Downloads
0
Visits
1
Download PDF

More from this volume

← Bridging the Gap between Saviours and Survivors: Exploring Uncertainties in Search, Rescue, Emergency, and Evacuation Operations in Earthquake and FloodCalibrating Managers' Trust in ICT-Enabled Visualized Information: A Case Study of Heat Illness Prevention at Infrastructure Maintenance Sites →
View all articles in Human Factors in Design, Engineering, and Computing →