Skip to content

Commit c3614c0

Browse files
committed
add RL system video
1 parent 09c6dc1 commit c3614c0

File tree

3 files changed

+12
-1
lines changed

3 files changed

+12
-1
lines changed

_pages/about.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,7 @@ latest_posts:
3232

3333
Thank you dear visitor for stopping by! I am a final year PhD candidate at University of Michigan, Ann Arbor. My research focus and interests are at the intersection of Machine Learning and Human-Computer Interaction (HCI).
3434

35-
I develop adaptive AI systems that <span style="color:deeppink;">enable people reason under risk and uncertainty in complex decision-making scenarios</span> by modeling their underlying thought processes—not just their observable behaviors. For example, in education, inferring students' conceptual gaps requires reconstructing their mental models from their learning trajectories, not just identifying surface-level mistakes. I borrow from <span style="color: deeppink">cognitive science and probabilistic machine learning</span> to design AI with experts' mental model to improve Human-AI interaction. By modeling people's latent cognitive states, my methods <span style="color: deeppink">improve reasoning of AI systems beyond observed behaviors</span>, improving overall learning efficiency and accuracy. I bring in strong computational and model building skills from my prior industry experience to build systems for Human-AI interaction and my training in HCI allows me to conduct large scale evaluations in people's work context for improving Human-AI interaction. For example., I recently built a bayesian network from a massive dataset of 3M records to model personal information and using it to study personalization - privacy trade-off. The following three broad directions describe my research focus and future vision.
35+
I develop adaptive AI systems that <span style="color:deeppink;">enable people to reason under risk and uncertainty in complex decision-making scenarios</span> by modeling their underlying thought processes and not just their observable behaviors. For example, in education, inferring students' conceptual gaps requires reconstructing their mental models from their learning trajectories, not just identifying surface-level mistakes. I borrow from <span style="color: deeppink">cognitive science and probabilistic machine learning</span> to design AI with experts' mental model to improve Human-AI interaction. By modeling people's latent cognitive states, my methods <span style="color: deeppink">improve reasoning of AI systems beyond observed behaviors</span>, improving overall learning efficiency and accuracy. I bring in strong computational and model building skills from my prior industry experience to build systems for Human-AI interaction and my training in HCI allows me to conduct large scale evaluations in people's work context for improving Human-AI interaction. For example, I recently built a bayesian network from a massive dataset of 3M records to model personal information and using it to study personalization - privacy trade-off. I have also applied my strong Reinforcement Learning (RL) foundations to modeling human behavior, which positions me well to explore RL-based fine-tuning of LLMs. For instance, I developed a [deep RL system](behavior_modeling/) from scratch to simulate indoor human behavior and COVID-19 transmission dynamics (code available on request), demonstrating how RL can capture and reason about complex behavioral patterns. The following three broad directions describe my research focus and future vision.
3636

3737
1. <b>Desiging computational models that can understand and improve expert decision-making</b> <span style="color:deeppink;">(AI to critique not obey)</span>: Furthering the design of computational models that can <span style="color:deeppink;">understand and reason about experts' decision processes, and how they reason about and balance principles in their decisions</span>. For example, understanding how instructors balance providing the answer versus guiding students in tutoring scenarios.
3838

_pages/custom.md

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
---
2+
layout: about
3+
title: A deep RL system demo for modeling indoor behavior and covid-19 transmissions
4+
permalink: /behavior_modeling
5+
6+
---
7+
8+
<video width="100%" controls>
9+
<source src="{{ site.baseurl }}/assets/video/behavior_modeling.mp4" type="video/mp4">
10+
Your browser does not support the video tag.
11+
</video>

assets/video/behavior_modeling.mp4

395 KB
Binary file not shown.

0 commit comments

Comments
 (0)