Artificial Intelligence

ARC offers on-prem Large Language Models (LLMs) for research, education, and administration. There are several ways to interact with LLMs in ARC:

• https://llm.arc.vt.edu offers a web interface to a selection of LLMs run by ARC.

• https://llm-api.arc.vt.edu offers API access to a selection of LLMs run by ARC.

• https://ood.arc.vt.edu offers a custom dedicated LLM via Open OnDemand.

We also provide guidance on using advanced tools:

• vLLM offers custom deployment via personalized Slurm scripts using safetensors format.

• llama.cpp offers custom deployment via personalized Slurm scripts using GGUF format.

• Ollama offers custom deployment via personalized Slurm scripts.

• Coding Agents and IDEs provides seamless integration of coding agents with ARC’s LLMs using API keys and IDEs.

If you have any questions about how ARC may support your AI needs, please contact us.