LLM

AgentOps provides tools to trace, debug, and deploy AI agents, with a Python package and engineering resources.

OpenLLM runs open-source language models as cloud API endpoints compatible with OpenAI clients.

Mind maps, flowcharts, and more than 300 frameworks can be generated on a single canvas in Jeda.ai visual workspace.

Suppr searches academic literature and translates documents, with tools for research reports and Zotero reference management.

Inworld provides real-time text-to-speech, speech-to-text, and language model inference through modular APIs.

GPUStack manages GPU clusters for serving AI models and provides on demand GPU instances accessible through SSH.

Neofuzz provides Python developers with a library for fuzzy text search.

OGAM is an offline AI app for phones and Mac with chat, vision, speech, image generation, and tool calling.

Canaryarena ranks AI models through chat, comparison, and community voting.

Ragas provides an evaluation framework for AI applications, according to its documentation page.

Orkes provides an agentic workflow platform for running AI agents with controls for reliability, durability, and explainability.

An interactive chart tracks the rise of large language models such as ChatGPT, Bing Chat, LaMDA, LLaMA, and PaLM.

Ollama helps users run and work with open models through a local AI tool.

ccusage analyzes token usage and estimated costs for coding agent command-line tools.

Change just one letter and get github repo context to use as context for your LLM.

CAMEL-AI brings together an open source community researching agents, data generation, world simulation, and task automation.

AptlyStar provides a no-code platform for building, training, and launching AI agents with multiple model integrations.

LLMSTXT.NEW generates an llms.txt file for any website using a dedicated generator interface.

OpenAgents provides a collaboration platform designed for networks of AI agents.

GitWit supports building software projects from ideas through an open-source AI-native coding platform.

Helicone provides an AI gateway for routing and monitoring AI applications.

Eden AI routes requests across language and other AI models through a unified API with provider options.

Neuron7 provides AI-guided troubleshooting and predictive recommendations for complex field service and customer support operations.

This article discusses challenges in evaluating language models and interpreting benchmark results.