rtp-llm

Activity, over time

Daily observations from the public event archive.

Attention

Daily stars & forks

Loading attention chart

Star accumulation

Cumulative stars

Loading star accumulation chart

Pull requests

Daily opens & merges

Loading pull requests chart

Conversations

Daily issues & comments

Loading conversations chart

Community

Daily accounts & reviews

Loading community chart

Releases

Daily releases

Loading releases chart

Mentions

2posts · 30d
Nov 50 posts
  1. Strata 等盛り上がっていますが、アリババさんは Qwen 用の独自推論エンジンを開発されないのでしょうか? …って聞いてみようとして下調べしたら普通にあった(∵) にわか乙!! ■RTP-LLM alibaba/rtp-llm ■MNN / MNN-LLM alibaba/MNN ■BladeLLM(クラウド推論最適化) — モデルの方に注力してるから既存の有名エンジンのサポートに重きを置いているのかしら…? わいが知らんかっただけ? #地元のLLM #LocalAIMeetup

    24 likes · 1 repost · 1,528 views
  2. If your current model deployment feels like it moves at geological speeds, Alibaba just dropped an inference engine meant to fix that specific bottleneck. alibaba/rtp-llm The 0.2.0 release brings broad performance upgrades and expanded model support without making your server rack weep. Keep it bookmarked for the next time production latency makes you question your career choices.

    1 like · 1 repost · 33 views

Latest stargazers

The last 10 distinct accounts we observed this year.

Most active participants

PR, issue, comment & review events in the past year.

Packages

Scan pending.

Live mentions badge

Show how many posts mention your project in the last 30 days.

Live mentions · last 30 days
alibaba/rtp-llm mentions in the last 30 days