Shawon Sarkar

I am a human-AI interaction and human-centered research scientist studying how people understand, interpret, and use information to complete tasks, and how systems can be designed to support learning, judgment, and agency rather than bypass the processes through which people learn and build knowledge.

My work sits at the intersection of human-computer interaction, interactive information retrieval, AI evaluation, and learning sciences, connecting technical advances with the real-world challenge of building systems that are trustworthy, equitable, and useful in practice. I focus on two connected threads: (1) modeling users’ evolving information needs from behavioral signals during complex, exploratory tasks to enable personalized, context-aware system support; and (2) designing evaluation frameworks and quality metrics that combine human judgment with automated methods to assess whether systems are useful, trustworthy, and aligned with user goals. Across both, my goal is to close the gap between what technologies can offer and what people actually need.

Currently, I am a Senior Applied Researcher at Seattle Jobs Initiative (SJI), where I work with state government partners on applied research and evaluation for workforce development programs serving underinvested communities.

Previously, I was a Research Scientist at UW College of Education’s AmplifyLearn.AI Center and a startup Colleague AI, where I focused on designing novel human-AI experiences for AI-powered K-12 education tools, with Dr. Min Sun (UW and Colleague AI), Prof. Ben Shapiro (UW), Prof. Jing Liu (UMD), Prof. Joshua Rosenberg (UTK) and Dr. Drew Nucci (WestEd). I partnered with educators and school districts to co-design AI features through mixed-methods approaches, and built evaluation pipelines with human-in-the-loop workflows and task-specific quality metrics. I also coordinated the ISEA program, a national AI and data science capacity-building initiative for education professionals. I served as a Co-PI on an NSF SBIR/STTR grant and an IES grant for the AmplifyGAIN Center, a national R&D center focused on the use of generative AI to enhance mathematics and science teaching and learning in K-12 schools.

I earned my Ph.D. in Information Science in 2023 from the Information School at the University of Washington, Seattle (UW), advised by Prof. Chirag Shah in the InfoSeeking Lab and RAISE. My doctoral research, supported by the NSF, developed conceptual and predictive models for inferring users’ evolving needs during complex search tasks. During my Ph.D., I did a research internship at Microsoft Research (KTX Group), where I worked on incomplete task prediction in collaborative systems. I also conducted community-engaged research with Indigenous scholars and communities under the mentorship of Prof. Clarita Lefthand-Begay and in partnership with the Northwest Portland Area Indian Health Board (NPAIHB), focused on Indigenous health equity and culturally responsive information practices.

Before UW, I spent the first two years of my Ph.D. at SC&I, Rutgers, The State University of New Jersey, New Brunswick, where I worked on information needs and task modeling. Earlier, as a Master’s student at Rutgers, I worked on computational argument mining with Prof. Nina Wacholder, Prof. Mark Aakhus, and Prof. Smaranda Muresan (CU) in the SALTS Lab, designing annotation workflows and managing large-scale corpus construction for NLP research. My path into information science came through earlier training in literature and language, and work in libraries and education.


Research methods. Mixed-methods study design; qualitative research (interviews, contextual inquiry, diary/logbook studies, focus groups, participatory co-design); evaluative research (usability testing, heuristic evaluation, cognitive walkthrough, pairwise comparison); behavioral log analysis; thematic analysis, grounded theory coding, codebook development with intercoder reliability; journey mapping, task analysis, persona development; human-in-the-loop evaluation and annotation workflow design

Quantitative & experimental methods. Experimental and quasi-experimental design (A/B testing, pre-post and matched-comparison designs); survey design and analysis; statistical analysis and hypothesis testing (regression, Chi-square, Fisher’s exact, Kruskal-Wallis, bootstrapping); clustering and classification; predictive modeling from behavioral signals

UX & evaluation metrics. UX, success and usability metrics (SUS, SEQ, UMUX-Lite, HEART framework, task success, time on task, TAM); cognitive load measurement (NASA-TLX); human-in-the-loop and human preference evaluation for AI systems

Technical. Python, R, SQL; NLP/ML, LLM evaluation, RAG systems, fine-tuning (LLMs)

Shawon.jpg

updates

Apr 2026 A co-authored paper, How Science Teachers Use AI: A Descriptive Portrait from a National Survey, will be presented by Dr. Joshua Rosenberg at the 2026 NARST 99th Annual International Conference (April 19-22, Seattle WA). Online program.
Apr 2026 Two first-author posters, one co-authored poster, and one co-authored paper from my research were presented at the AERA 2026 Annual Meeting (April 8–12, LA, CA).

selected publications

  1. Understanding Teachers’ Use of Generative AI in Math and Science Instruction
    Shawon Sarkar, Lief Esbenshade, Drew Nucci, Sarah Nielsen, Anne R. Edwards, Joshua Rosenberg, Alex Liu, Zewei Tian, Zachary Zhang, Kevin He, and Min Sun
    In AERA i-Presentation Gallery, 2026
  2. AmplifyGAIN: National Capacity-Building for Trustworthy AI in Education
    Shawon Sarkar, Lief Esbenshade, Min Sun, Alex Liu, Zewei Tian, Kevin He, and Zachary Zhang
    In AERA i-Presentation Gallery, 2026
  3. How Science Teachers Use AI: A Descriptive Portrait from a National Survey
    Joshua Rosenberg, Shawon Sarkar, Lief Esbenshade, Drew Nucci, Sarah Nielsen, Anne R. Edwards, Alex Liu, Zewei Tian, Zachary Zhang, and Min Sun
    In , 2026
  4. Collaborative and Adaptive Learning: Designing AI Educational Systems with and for Educators
    Shawon Sarkar, Alex Liu, R. Benjamin Shapiro, and Min Sun
    In Proceedings of the 19th International Conference of the Learning Sciences - ICLS 2025, 2025
  5. Connecting Feedback to Choice: Understanding Educator Preferences in GenAI vs. Human-Created Lesson Plans in K-12 Education – A Comparative Analysis
    Shawon Sarkar, Min Sun, Alex Liu, Zewei Tian, Lief Esbenshade, Jian He, and Zachary Zhang
    Arxiv Preprint, 2025
  6. From Practice to Nudge: A Hybrid Intelligence Framework for Instructional Decision Support
    Alex Liu, Shawon Sarkar, Lief Esbenshade, Victor Tian, Kevin He, Zachary Zhang, and Min Sun
    In Proceedings of the Workshops at the Fourth International Conference on Hybrid Human-Artificial Intelligence, Pisa, Italy, 2025
  7. Towards More Personalized Recommendations by Modeling Users? Temporal Behaviors with Task-Based Graph Neural Network (TGNN)
    Maryam Amirizaniani, Shawon Sarkar, and Chirag Shah
    ACM Transactions on the Web, 2025
  8. Representing Tasks with a Graph-Based Method for Supporting Users in Complex Search Tasks
    Shawon Sarkar, Maryam Amirizaniani, and Chirag Shah
    In Proceedings of the 2023 Conference on Human Information Interaction and Retrieval, Austin, TX, USA, 2023
  9. Taking Search to Task
    Chirag Shah, Ryen White, Paul Thomas, Bhaskar Mitra, Shawon Sarkar, and Nicholas Belkin
    In Proceedings of the 2023 Conference on Human Information Interaction and Retrieval, Austin, TX, USA, 2023
  10. A Synthetic Search Session Generator for Task-Aware Information Seeking and Retrieval
    Shawon Sarkar and Chirag Shah
    In Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining, Singapore, Singapore, 2023
  11. Cultivating a Space for Intergenerational Directed Research Groups for Indigenous Students and Allies through Indigenous Knowledge Families
    Clarita Lefthand-Begay, Nicole S. Kuhn, Turam Purty, Tessa R Campbell, Shawon Sarkar, Jesse Brisbois, Robin Ruhm, Kunsang Choden, Ana Rodriguez, Celena J. Ghost Dog, Jean M. Dennison, Shayla Chatto, and Rona Guo
    Wicazo Sa Review, 2022
  12. An Integrated Model of Task, Information Needs, Sources and Uncertainty to Design Task-Aware Search Systems
    Shawon Sarkar and Chirag Shah
    In Proceedings of the 2021 ACM SIGIR International Conference on Theory of Information Retrieval, Virtual Event, Canada, 2021
  13. Decolonizing Risk Communication: Indigenous Responses to COVID-19 using Social Media
    Nicole Kuhn, Shawon Sarkar, Lauren Alaine White, Josephine Hoy, Celena McCray, and Clarita Lefthand-Begay
    Journal of Indigenous Social Development, 2020
  14. Identifying and Predicting the States of Complex Search Tasks
    Jiqun Liu, Shawon Sarkar, and Chirag Shah
    In Proceedings of the 2020 Conference on Human Information Interaction and Retrieval, Vancouver BC, Canada, 2020
  15. Implicit Information Need as Explicit Problems, Help, and Behavioral Signals
    Shawon Sarkar, Matthew Mitsui, Jiqun Liu, and Chirag Shah
    Information Processing & Management, 2020