Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: abetlen/llama-cpp-python
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: main
Choose a base ref
...
head repository: Limour-dev/llama-cpp-python
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: main
Choose a head ref
  • 5 commits
  • 4 files changed
  • 2 contributors

Commits on Mar 28, 2024

  1. add KV cache quantization options 

    #1220
#1305
    @Limour-dev
    Limour-dev authored Mar 28, 2024
    Configuration menu
    Copy the full SHA
    94a9519 View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2024

  1. Merge branch 'main' into Limour-dev/main

    @abetlen
    abetlen committed Mar 31, 2024
    Configuration menu
    Copy the full SHA
    c4a2f85 View commit details
    Browse the repository at this point in the history

  2. Add ggml_type

    @abetlen
    abetlen committed Mar 31, 2024
    Configuration menu
    Copy the full SHA
    1a6a9a3 View commit details
    Browse the repository at this point in the history

  3. Use ggml_type instead of string for quantization

    @abetlen
    abetlen committed Mar 31, 2024
    Configuration menu
    Copy the full SHA
    fcb8051 View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2024

  1. Add server support

    @abetlen
    abetlen committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    7828382 View commit details
    Browse the repository at this point in the history
Loading