So far, running LLMs has required a large amount of computing resources, mainly GPUs. Running locally, a simple prompt with a typical LLM takes on an average Mac ...
You can find all relevant python packages in the requirements.txt. It is recommendet to use a virtual environment to manage your requirements for this project. Use ...