Portrait of Ruijie Zheng

Ruijie Zheng

HCI/VLA/LLM Security

Undergraduate in Computer Science,
University of Michigan, Ann Arbor

About Me

I am an undergraduate student studying Computer Science at the University of Michigan. Before Michigan, I studied Mechanical Engineering at the Joint Institute of Shanghai Jiao Tong University.

My research interests are human–computer interaction (HCI), vision–language–action (VLA) models, and the security of large language models. I enjoy problems where algorithms meet real people, real data, and real-world constraints.

Publications

Weather-Guard: A Real-Time Dynamic Contextual Guardrail for Agentic AI Interactions

Gordon Tsai, Zewen Sun, Haoran Dai, Haiqi Shen, Ruijie Zheng, Haotian Zhang, Yaoyao Qian, Binghui Wang, Kyrie Zhou

ICASSP 2027 · Under review

General Accessibility Model: Understanding Accessibility Needs from Computer Use

Yuxuan Liu, Ruijie Zheng, Brandon Kim, Jason Wu, Anhong Guo

CHI 2027 Papers · Under review

Selected Work click / drag / ← →

Research & Publications · 2026

General Accessibility Model (GAM)

Human–AI Lab, University of Michigan · Prof. Anhong Guo

01 / 06

Research & Projects

The deck above highlights selected work. Here is the full record.

University of MichiganMay 2026 – PresentResearch

General Accessibility Model (GAM)

Human-AI Lab, University of Michigan · Prof. Anhong Guo

Second author of GAM (UIST ’26 demo accepted; CHI ’27 paper under review), which learns users' accessibility needs by observing everyday computer use instead of explicit calibration tasks. Built the macOS multimodal capture pipeline (screen, assistive-technology audio, input, DOM) and the LLM reflection loop that yields confidence-weighted barrier propositions, applied to accessibility reports, feature recommendation, and just-in-time web repair.

University of Michigan2026Research

Weather-Guard: Dynamic Contextual Guardrail for Agentic AI

Multi-institution collaboration · ICASSP 2027 (under review)

Co-authored a real-time guardrail for agentic AI interactions: an 82M-parameter DistilRoBERTa encoder, cascaded with regex rules, flags privacy and security risks within a <50 ms budget and surfaces them through weather-style risk cues and inline highlights rather than automatic rewriting. It outperforms larger models on zero-shot out-of-distribution privacy detection, and a study with nine families found most participants preferred transparent warnings with manual authorization.

Northwestern UniversityMar 2026 – PresentResearch

Backdoor Attacks on Latent Reasoning Models

LIST Lab, Northwestern University · Prof. Yan Chen

Studying backdoor mechanisms on latent reasoning models with a focus on trigger injection and reasoning-specific attack behavior, and evaluating attack success, activation patterns, and robustness under reasoning-heavy benchmarks.

University of MichiganSep – Dec 2025Course Project

LLM-Driven Tennis Coaching System

University of Michigan, Ann Arbor

Built an end-to-end pipeline extracting pose landmarks from tennis videos with MediaPipe and Sport2D, using heuristic keyframe selection and phase-aware LLM prompting to synthesize personalized coaching feedback.

University of MichiganAug – Dec 2025Research

Sparse Weight-Decomposed LoRA (SDoRA)

University of Michigan, Ann Arbor

Proposed a parameter-efficient fine-tuning framework combining weight decomposition with learnable sparse gating. Implemented the SoRA module, trained Qwen2.5-3B models, and analyzed sparsity dynamics and layer-wise pruning on BoolQ, PIQA, and ARC-c.

Shanghai Jiao Tong UniversityNov 2024 – PresentResearch

Water Jet Propulsion via Negative Pressure Energy Storage

School of Mechanical Engineering, SJTU

Constructed control logic in Simulink, explored reinforcement-learning-based optimization, and modeled spacecraft shell structures in SolidWorks.

Shanghai Jiao Tong UniversityJan – Oct 2024Research

Multi-Modality Federated Learning

School of Electronic Information and Electrical Engineering, SJTU

Reproduced federated learning algorithms such as FedAvg and Harmony in PyTorch, and explored ways to improve efficiency when processing multi-modal data.

Shanghai Jiao Tong UniversityFeb – Oct 2024Innovation Program

Cross Twin-Rotor Unmanned Helicopter

School of Electronic Information and Electrical Engineering, SJTU

Used quaternion representations to implement part of the aircraft control algorithm and contributed to mechanical assembly of the prototype.

Shanghai Jiao Tong UniversityMay – Aug 2024Course Design

Mars Rover Model

Joint Institute, SJTU

Handled 3D modeling for an introductory engineering design project, assembled the rover, and implemented part of its control algorithm.

Education

University of MichiganAug 2025 – Present

University of Michigan, Ann Arbor

College of Engineering · B.S. in Computer Science

GPA: 3.947 / 4.0

Shanghai Jiao Tong UniversitySep 2023 – Jul 2025

Shanghai Jiao Tong University

Joint Institute · Mechanical Engineering

GPA: 3.78 / 4.0 · Ranked 48 / 335

Skills

Programming & Modeling

Python, PyTorch, MATLAB, Simulink, Mathematica

Design & Prototyping

SolidWorks, Arduino, Raspberry Pi, 3D printing, CO2 laser cutting

Service & Teaching

Sep 2024 – Present

Vice President, ASME Student Branch

Joint Institute, SJTU

Organized workshops and lectures on mechanical engineering topics and maintained the branch's official webpage.

Sep 2024 – Jan 2025

Teaching Assistant, MATH1860J Honors Mathematics

Joint Institute, SJTU

Held recitations and office hours, prepared worksheets, and graded assignments and exams.

May & Aug 2024

Volunteer Teaching

Yingshang, Anhui

Gave basic physics and mathematics lectures for primary school students and organized extracurricular activities.

Contact

Email is the best way to reach me.