Skip to content

Commit 746e768

Browse files
abetlenabetlen
committed
Deployed cbac19b with MkDocs version: 1.4.3
1 parent eab577e commit 746e768

File tree

3 files changed

+14
-14
lines changed

3 files changed

+14
-14
lines changed

‎index.html

Lines changed: 13 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -3190,10 +3190,10 @@ <h2 id="llama_cpp.Llama" class="doc doc-heading">
31903190
</span><span id="__span-0-446"><a id="__codelineno-0-446" name="__codelineno-0-446"></a> <span class="k">def</span> <span class="nf">generate</span><span class="p">(</span>
31913191
</span><span id="__span-0-447"><a id="__codelineno-0-447" name="__codelineno-0-447"></a> <span class="bp">self</span><span class="p">,</span>
31923192
</span><span id="__span-0-448"><a id="__codelineno-0-448" name="__codelineno-0-448"></a> <span class="n">tokens</span><span class="p">:</span> <span class="n">Sequence</span><span class="p">[</span><span class="n">llama_cpp</span><span class="o">.</span><span class="n">llama_token</span><span class="p">],</span>
3193-
</span><span id="__span-0-449"><a id="__codelineno-0-449" name="__codelineno-0-449"></a> <span class="n">top_k</span><span class="p">:</span> <span class="nb">int</span><span class="p">,</span>
3194-
</span><span id="__span-0-450"><a id="__codelineno-0-450" name="__codelineno-0-450"></a> <span class="n">top_p</span><span class="p">:</span> <span class="nb">float</span><span class="p">,</span>
3195-
</span><span id="__span-0-451"><a id="__codelineno-0-451" name="__codelineno-0-451"></a> <span class="n">temp</span><span class="p">:</span> <span class="nb">float</span><span class="p">,</span>
3196-
</span><span id="__span-0-452"><a id="__codelineno-0-452" name="__codelineno-0-452"></a> <span class="n">repeat_penalty</span><span class="p">:</span> <span class="nb">float</span><span class="p">,</span>
3193+
</span><span id="__span-0-449"><a id="__codelineno-0-449" name="__codelineno-0-449"></a> <span class="n">top_k</span><span class="p">:</span> <span class="nb">int</span> <span class="o">=</span> <span class="mi">40</span><span class="p">,</span>
3194+
</span><span id="__span-0-450"><a id="__codelineno-0-450" name="__codelineno-0-450"></a> <span class="n">top_p</span><span class="p">:</span> <span class="nb">float</span> <span class="o">=</span> <span class="mf">0.95</span><span class="p">,</span>
3195+
</span><span id="__span-0-451"><a id="__codelineno-0-451" name="__codelineno-0-451"></a> <span class="n">temp</span><span class="p">:</span> <span class="nb">float</span> <span class="o">=</span> <span class="mf">0.80</span><span class="p">,</span>
3196+
</span><span id="__span-0-452"><a id="__codelineno-0-452" name="__codelineno-0-452"></a> <span class="n">repeat_penalty</span><span class="p">:</span> <span class="nb">float</span> <span class="o">=</span> <span class="mf">1.1</span><span class="p">,</span>
31973197
</span><span id="__span-0-453"><a id="__codelineno-0-453" name="__codelineno-0-453"></a> <span class="n">reset</span><span class="p">:</span> <span class="nb">bool</span> <span class="o">=</span> <span class="kc">True</span><span class="p">,</span>
31983198
</span><span id="__span-0-454"><a id="__codelineno-0-454" name="__codelineno-0-454"></a> <span class="n">frequency_penalty</span><span class="p">:</span> <span class="nb">float</span> <span class="o">=</span> <span class="mf">0.0</span><span class="p">,</span>
31993199
</span><span id="__span-0-455"><a id="__codelineno-0-455" name="__codelineno-0-455"></a> <span class="n">presence_penalty</span><span class="p">:</span> <span class="nb">float</span> <span class="o">=</span> <span class="mf">0.0</span><span class="p">,</span>
@@ -4933,7 +4933,7 @@ <h3 id="llama_cpp.llama.Llama.sample" class="doc doc-heading">
49334933

49344934

49354935
<h3 id="llama_cpp.llama.Llama.generate" class="doc doc-heading">
4936-
<code class="highlight language-python"><span class="n">generate</span><span class="p">(</span><span class="n">tokens</span><span class="p">,</span> <span class="n">top_k</span><span class="p">,</span> <span class="n">top_p</span><span class="p">,</span> <span class="n">temp</span><span class="p">,</span> <span class="n">repeat_penalty</span><span class="p">,</span> <span class="n">reset</span><span class="o">=</span><span class="kc">True</span><span class="p">,</span> <span class="n">frequency_penalty</span><span class="o">=</span><span class="mf">0.0</span><span class="p">,</span> <span class="n">presence_penalty</span><span class="o">=</span><span class="mf">0.0</span><span class="p">,</span> <span class="n">tfs_z</span><span class="o">=</span><span class="mf">1.0</span><span class="p">,</span> <span class="n">mirostat_mode</span><span class="o">=</span><span class="mi">0</span><span class="p">,</span> <span class="n">mirostat_tau</span><span class="o">=</span><span class="mf">5.0</span><span class="p">,</span> <span class="n">mirostat_eta</span><span class="o">=</span><span class="mf">0.1</span><span class="p">)</span></code>
4936+
<code class="highlight language-python"><span class="n">generate</span><span class="p">(</span><span class="n">tokens</span><span class="p">,</span> <span class="n">top_k</span><span class="o">=</span><span class="mi">40</span><span class="p">,</span> <span class="n">top_p</span><span class="o">=</span><span class="mf">0.95</span><span class="p">,</span> <span class="n">temp</span><span class="o">=</span><span class="mf">0.8</span><span class="p">,</span> <span class="n">repeat_penalty</span><span class="o">=</span><span class="mf">1.1</span><span class="p">,</span> <span class="n">reset</span><span class="o">=</span><span class="kc">True</span><span class="p">,</span> <span class="n">frequency_penalty</span><span class="o">=</span><span class="mf">0.0</span><span class="p">,</span> <span class="n">presence_penalty</span><span class="o">=</span><span class="mf">0.0</span><span class="p">,</span> <span class="n">tfs_z</span><span class="o">=</span><span class="mf">1.0</span><span class="p">,</span> <span class="n">mirostat_mode</span><span class="o">=</span><span class="mi">0</span><span class="p">,</span> <span class="n">mirostat_tau</span><span class="o">=</span><span class="mf">5.0</span><span class="p">,</span> <span class="n">mirostat_eta</span><span class="o">=</span><span class="mf">0.1</span><span class="p">)</span></code>
49374937

49384938
</h3>
49394939

@@ -4977,7 +4977,7 @@ <h3 id="llama_cpp.llama.Llama.generate" class="doc doc-heading">
49774977
</td>
49784978
<td><p>The top-k sampling parameter.</p></td>
49794979
<td>
4980-
<em>required</em>
4980+
<code>40</code>
49814981
</td>
49824982
</tr>
49834983
<tr>
@@ -4987,7 +4987,7 @@ <h3 id="llama_cpp.llama.Llama.generate" class="doc doc-heading">
49874987
</td>
49884988
<td><p>The top-p sampling parameter.</p></td>
49894989
<td>
4990-
<em>required</em>
4990+
<code>0.95</code>
49914991
</td>
49924992
</tr>
49934993
<tr>
@@ -4997,7 +4997,7 @@ <h3 id="llama_cpp.llama.Llama.generate" class="doc doc-heading">
49974997
</td>
49984998
<td><p>The temperature parameter.</p></td>
49994999
<td>
5000-
<em>required</em>
5000+
<code>0.8</code>
50015001
</td>
50025002
</tr>
50035003
<tr>
@@ -5007,7 +5007,7 @@ <h3 id="llama_cpp.llama.Llama.generate" class="doc doc-heading">
50075007
</td>
50085008
<td><p>The repeat penalty parameter.</p></td>
50095009
<td>
5010-
<em>required</em>
5010+
<code>1.1</code>
50115011
</td>
50125012
</tr>
50135013
<tr>
@@ -5123,10 +5123,10 @@ <h3 id="llama_cpp.llama.Llama.generate" class="doc doc-heading">
51235123
<span class="normal"><a href="#__codelineno-0-523">523</a></span></pre></div></td><td class="code"><div><pre><span></span><code><span id="__span-0-446"><a id="__codelineno-0-446" name="__codelineno-0-446"></a><span class="k">def</span> <span class="nf">generate</span><span class="p">(</span>
51245124
</span><span id="__span-0-447"><a id="__codelineno-0-447" name="__codelineno-0-447"></a> <span class="bp">self</span><span class="p">,</span>
51255125
</span><span id="__span-0-448"><a id="__codelineno-0-448" name="__codelineno-0-448"></a> <span class="n">tokens</span><span class="p">:</span> <span class="n">Sequence</span><span class="p">[</span><span class="n">llama_cpp</span><span class="o">.</span><span class="n">llama_token</span><span class="p">],</span>
5126-
</span><span id="__span-0-449"><a id="__codelineno-0-449" name="__codelineno-0-449"></a> <span class="n">top_k</span><span class="p">:</span> <span class="nb">int</span><span class="p">,</span>
5127-
</span><span id="__span-0-450"><a id="__codelineno-0-450" name="__codelineno-0-450"></a> <span class="n">top_p</span><span class="p">:</span> <span class="nb">float</span><span class="p">,</span>
5128-
</span><span id="__span-0-451"><a id="__codelineno-0-451" name="__codelineno-0-451"></a> <span class="n">temp</span><span class="p">:</span> <span class="nb">float</span><span class="p">,</span>
5129-
</span><span id="__span-0-452"><a id="__codelineno-0-452" name="__codelineno-0-452"></a> <span class="n">repeat_penalty</span><span class="p">:</span> <span class="nb">float</span><span class="p">,</span>
5126+
</span><span id="__span-0-449"><a id="__codelineno-0-449" name="__codelineno-0-449"></a> <span class="n">top_k</span><span class="p">:</span> <span class="nb">int</span> <span class="o">=</span> <span class="mi">40</span><span class="p">,</span>
5127+
</span><span id="__span-0-450"><a id="__codelineno-0-450" name="__codelineno-0-450"></a> <span class="n">top_p</span><span class="p">:</span> <span class="nb">float</span> <span class="o">=</span> <span class="mf">0.95</span><span class="p">,</span>
5128+
</span><span id="__span-0-451"><a id="__codelineno-0-451" name="__codelineno-0-451"></a> <span class="n">temp</span><span class="p">:</span> <span class="nb">float</span> <span class="o">=</span> <span class="mf">0.80</span><span class="p">,</span>
5129+
</span><span id="__span-0-452"><a id="__codelineno-0-452" name="__codelineno-0-452"></a> <span class="n">repeat_penalty</span><span class="p">:</span> <span class="nb">float</span> <span class="o">=</span> <span class="mf">1.1</span><span class="p">,</span>
51305130
</span><span id="__span-0-453"><a id="__codelineno-0-453" name="__codelineno-0-453"></a> <span class="n">reset</span><span class="p">:</span> <span class="nb">bool</span> <span class="o">=</span> <span class="kc">True</span><span class="p">,</span>
51315131
</span><span id="__span-0-454"><a id="__codelineno-0-454" name="__codelineno-0-454"></a> <span class="n">frequency_penalty</span><span class="p">:</span> <span class="nb">float</span> <span class="o">=</span> <span class="mf">0.0</span><span class="p">,</span>
51325132
</span><span id="__span-0-455"><a id="__codelineno-0-455" name="__codelineno-0-455"></a> <span class="n">presence_penalty</span><span class="p">:</span> <span class="nb">float</span> <span class="o">=</span> <span class="mf">0.0</span><span class="p">,</span>

‎search/search_index.json

Lines changed: 1 addition & 1 deletion
Large diffs are not rendered by default.

‎sitemap.xml.gz

0 Bytes
Binary file not shown.

0 commit comments

Comments
 (0)