stanford-oval

Activity

Stars and mentions · Last 30 days, Oct 6 – Nov 4

GitHub stars182
Mentions6
06121824Oct 6Oct 20Nov 4
UTC days · repositories stanford-oval owns2 repositories

Top repositories

stanford-oval’s repositories ranked by new stars, as on trending.

Loading

Contributes to

Repositories outside stanford-oval’s account where stanford-oval opened or reviewed pull requests in the past 365 days.

Who noticed stanford-oval

Everyone who starred or forked stanford-oval’s repositories since the archive began in 2011.

Notable accounts

Ordered by the stars their own repositories have received.

Biggest fans

Accounts that starred the most of these repositories.

Breakout weeks

Each repository’s best week of new stars, with the release published around it.

Mentions

5posts
Nov 50 posts
  1. Did the Model Use That? Counterfactual Training Boosts Self-Attribution in Language Models Zikai Zhou, Jiacheng Sang, Yilin Xu, Yufei Jin, Monica S. Lam arxiv.org [𝚌𝚜.𝙲𝙻 𝚌𝚜.𝙰𝙸] 💬Code: stanford-oval/CREDIT t.co

    1 like · 43 views
  2. arXiv · · cs.CL · Zikai Zhou · stanford-oval/CREDIT

    Did the Model Use That? Counterfactual Training Boosts Self-Attribution in Language Models A fundamental challenge for explainable and accountable language models is revealing how external information influences their answers. This paper examines whether models are self-attributive: that is, whether they indicate when -- and only when -- their responses to questions are influenced by information provided alongside the question. Furthermore, we explore how self-attribution can be improved through counterfactual training, which explicitly teaches models to distinguish between answers that do and do not depend on supplied information. We found that most of the eleven frontier models rarely attribute influential information in their answers, and the rest attribute non-influential information. Training acknowledgment into reasoning does not fix this: the acknowledgment does not reach the final answer. We introduce CREDIT, which directly supervises final-answer self-attribution with counterfactual labels, without the need for human annotation. CREDIT substantially improves attribution in four open models, including two distilled reasoning models, and outperforms reasoning-level fine-tuning and prompting baselines. Among answers that agree with a user's suggestion, CREDIT distinguishes those changed by the suggestion from those the model would have given anyway. Gains transfer partly to unseen information types and prompts containing sources that support conflicting answers. Comments: 29 pages, 5 figures, 20 tables. Code: stanford-oval/CREDIT

  3. Paper: arxiv.org Project page, videos, results: sheldon.genie.stanford.edu Code, prompts, configs: stanford-oval/sheldon Joint work with my amazing co-authors @PriyankShethia (equal contribution) and @MonicaSLam , Stanford OVAL (@StanfordOVAL) .

    5 likes · 79 views
  4. Trials & patients → SMT programs, canonicalized to SNOMED CT, projected to SQL with 100% recall w.r.t. the SMT constraints. 📈 +32–72% relevant & eligible trials vs. TrialGPT 📈 1.8–3.2× recall on TREC 2022 ⚡ 146 ms/patient Code is open source 👇 stanford-oval/clinical-trial-matching

    33 views
  5. @MonicaSLam @YuchengJiang0 @stanfordnlp @StanfordOVAL Paper: arxiv.org Code: stanford-oval/DataSTORM

    2 likes · 60 views

Achievements

Awards earned by the repositories stanford-oval owns. Select an award to embed its badge.

Gold
21st place finishes
Silver
22nd place finishes
Bronze
03rd place finishes
Awarded repositories
1Owned by stanford-oval now

Repositories

Ordered by gold, then silver, then bronze.

  1. stormBest: 1st by stars, 1,019 stars220

Every award

Top-three finishes of these repositories in completed trending days and weeks, newest first.

  1. storm
  2. storm
  3. storm
  4. storm

A repository earns an award for finishing first, second or third in a completed trending day or week, ranked by new stars, new forks or pull request authors. Awards follow a repository through renames and transfers and count toward its current owner. Weeks run Monday to Sunday, UTC.