关键词: 知识蒸馏, 轻量化模型, 课堂行为检测, 模型剪枝, 学生模型

Abstract: Aiming at the problems of large scale and high computational cost in existing high-accuracy object detection models,  it was difficult to deploy them widely in resource-limited  environments, we proposed a colaborative lightweight method  that integrated knowledge distillation, model quantization, and network pruning to construct an efficient  behavior detection model suitable for classroom scenarios. The method first achieved effective knowledge transfer from large to medium and small models through step-by-step distillation,  then combined structured pruning  to obtain a  lightweight  network equivalent to small-scale models, and further used  quantized feature distillation  to enhance feature expression ability of the model in  quantization-aware training.  Experimental results show  that the improved lightweight model has significantly higher detection accuracy than the original small  model  while  maintaining a small parameter size and  computational complexity. Its performance has steadily improved  on multiple classroom behavior datasets.

Key words: knowledge distillation, lightweight model, classroom behavior detection, model pruning, student model