Artificial Intelligence

ARC offers on-prem Large Language Models (LLMs) for research, education, and administration. There are several ways to interact with LLMs in ARC:

• https://llm.arc.vt.edu offers a web interface to a selection of LLMs run by ARC.

• https://llm-api.arc.vt.edu offers API access to a selection of LLMs run by ARC.

• https://ood.arc.vt.edu offers a custom dedicated LLM via Open OnDemand.

We also provide guidance on using advanced tools:

• vLLM offers advanced custom deployment via personalized Slurm scripts.

• IDEs and AI Assistants provides seamless integration of IDEs such as VS Code and IntelliJ with ARC’s LLMs using API keys.

If you have any questions about how ARC may support your AI needs, please contact us.