The high-level API provides a simple managed interface through the `Llama` class.

Below is a short example demonstrating how to use the high-level API to generate text:

The low-level API is a direct [`ctypes`](https://docs.python.org/3/library/ctypes.html) binding to the C API provided by `llama.cpp`.

The entire lowe-level API can be found in [llama_cpp/llama_cpp.py](https://github.com/abetlen/llama-cpp-python/blob/master/llama_cpp/llama_cpp.py) and directly mirrors the C API in [llama.h](https://github.com/ggerganov/llama.cpp/blob/master/llama.h).

Below is a short example demonstrating how to use the low-level API to tokenize a prompt:

>>> import llama_cpp

>>> import ctypes

>>> params = llama_cpp.llama_context_default_params()

>>> ctx = llama_cpp.llama_init_from_file(b"./models/7b/ggml-model.bin", params)

>>> max_tokens = params.n_ctx

>>> tokens = (llama_cppp.llama_token * int(max_tokens))()

>>> n_tokens = llama_cpp.llama_tokenize(ctx, b"Q: Name the planets in the solar system? A: ", tokens, max_tokens, add_bos=llama_cpp.c_bool(True))

>>> llama_cpp.llama_free(ctx)

Check out the [examples folder](examples/low_level_api) for more examples of using the low-level API.