AI Data & Analytics

LLMrefs tracks brand visibility, rankings, and citations across generative AI search tools and benchmarks competitors.

DVCLive logs and tracks machine learning metrics, parameters, and models with Git or DVC.

This project profiles data quality and supports exploratory analysis of Pandas and Spark DataFrames.

Pyro brings probabilistic programming capabilities to Python projects using PyTorch.

Access full-text academic articles: J-STAGE is an online platform for Japanese academic journals.

A free downloadable guide covering strategies for testing large language models and analyzing their behavior.

A tool to help you configure, organize, log and reproduce experiments.

Research on evaluation of LLMs conducted by Microsoft Research and other collaborated institutes. (Updated at: 2023/10).

Sourcetable combines spreadsheets and data analysis tools for creating financial models and working with datasets.

A federated, open-source data catalog for all your big data and small data.

Disco’s discovery engine finds statistically validated patterns in tabular data, including feature interactions and subgroup effects.

Vearch provides distributed vector search capabilities for applications built around artificial intelligence.

Python library for decision tree visualization and model interpretation.

BlockSurvey creates privacy-first forms and surveys with end-to-end encrypted responses, plus AI-assisted question writing.

Calculate language model API costs using input, cached input, and output token counts.

FastDatasets helps create training datasets for large language models.

Chris Albon’s site describes a project that uses visitor activity to build an open map of congressional hearings.

BambooAI analyzes data with a language model in a persistent Python kernel and supports web and Docker workflows.

Alison.ai analyzes advertising creatives and provides creative scores, predictive insights, and competitor benchmarks for brands and agencies.

BOND.AI provides banking AI tools for forecasting, benchmarking, risk analysis, and customer engagement for banks and credit unions.

An open source Python library for drift detection in machine learning systems.

KNIME provides data analysis tools and a visual workflow builder for data science solutions.

AIF360 provides fairness metrics and explanations for datasets and models, along with algorithms to mitigate bias.

Alex Smola publishes Adventures in Data Land, a blog with posts on data and related subjects.