Text Generation Inference

<div class="dln" itemprop="articleBody"><div class="shdw top"> </div><pre class="cd"><code class="language-">podman run --gpus all --shm-size 1g -p 9389:80 -v $PWD/data:/data ghcr.io/huggingface/text-generation-inference:2.1.1 --model-id Qwen/Qwen2-0.5B
</code></pre><div class="shdw btm"> </div><button type="button" class="mxmz icn_ btn_mxmz"></button></div>

<div class="dln" itemprop="articleBody"><div class="shdw top"> </div><p><a class="URI" href="https://huggingface.co/docs/text-generation-inference/index" target="_blank" rel="noopener nofollow ugc">https://huggingface.co/docs/text-generation-inference/index</a>
</p><div class="shdw btm"> </div><button type="button" class="mxmz icn_ btn_mxmz"></button></div>

『Text Generation Inference』

<div class="dln" itemprop="articleBody"><div class="shdw top"> </div><p><a class="URI" href="https://huggingface.co/docs/text-generation-inference/basic_tutorials/consuming_tgi" target="_blank" rel="noopener nofollow ugc">https://huggingface.co/docs/text-generation-inference/basic_tutorials/consuming_tgi</a>
</p><div class="shdw btm"> </div><button type="button" class="mxmz icn_ btn_mxmz"></button></div>

t_wの輪郭

Text Generation Inference

あれ

『Text Generation Inference』

『Consuming Text Generation Inference』