The allenai organization on GitHub hosts a wide range of public repositories primarily focused on artificial intelligence and natural language processing. Key projects include allennlp, an open-source NLP research library, and olmocr, a toolkit for linearizing PDFs for LLM datasets. Their repositories leverage various programming languages, with a strong emphasis on Python, C#, and Scala.
Top languages
Public repositories
olmocr
Toolkit for linearizing PDFs for LLM datasets/training
allennlp
An open-source NLP research library, built on PyTorch.
OLMo
Modeling, training, eval, and inference code for OLMo
open-instruct
AllenAI's post-training codebase
RL4LMs
A modular RL library to fine-tune language models to human preferences
longformer
Longformer: The Long-Document Transformer
scispacy
A full spaCy pipeline and models for scientific/biomedical documents.
ai2thor
An open-source platform for Visual AI.
scibert
A BERT model for scientific text.
dolma
Data and tools for generating and inspecting OLMo pre-training data.
objaverse-xl
🪐 Objaverse-XL is a Universe of 10M+ 3D Objects. Contains API Scripts for Downloading and Processing!
OLMo-core
PyTorch building blocks for the OLMo ecosystem
s2orc
S2ORC: The Semantic Scholar Open Research Corpus: https://www.aclweb.org/anthology/2020.acl-main.447/
natural-instructions
Expanding natural instructions
OLMoE
OLMoE: Open Mixture-of-Experts Language Models
molmo
Code for the Molmo Vision-Language Model
XNOR-Net
ImageNet classification using binary Convolutional Neural Networks
papermage
library supporting NLP and CV research on scientific papers
visprog
Official code for VisProg (CVPR 2023 Best Paper!)
scitldr
No description provided for this repository.
pdffigures2
Given a scholarly PDF, extract figures, tables, captions, and section titles.
reward-bench
RewardBench: the first evaluation tool for reward models.
molmo2
Code for the Molmo2 Vision-Language Model
molmoact2
Official Repository for MolmoAct2
specter
SPECTER: Document-level Representation Learning using Citation-informed Transformers
WildDet3D
Allen Institute for AI: WildDet3D: Scaling Promptable 3D Detection in the Wild
molmoweb
No description provided for this repository.
allennlp-models
Officially supported AllenNLP models
Holodeck
CVPR 2024: Language Guided Generation of 3D Embodied AI Environments.
dont-stop-pretraining
Code associated with the Don't Stop Pretraining ACL 2020 paper
OLMoASR
An open-source implementation of Whisper
s2orc-doc2json
Parsers for scientific papers (PDF2JSON, TEX2JSON, JATS2JSON)
procthor
🏘️ Scaling Embodied AI by Procedurally Generating Interactive 3D Houses
deep_qa
A deep NLP library, based on Keras / tf, focused on question answering (but useful for other NLP too)
allenact
An open source framework for research in Embodied-AI from AI2.
olmes
Reproducible, flexible LLM evaluations
molmoact
Official Repository for MolmoAct
vla-evaluation-harness
One framework to evaluate any VLA model on any robot simulation benchmark.
ScienceWorld
ScienceWorld is a text-based virtual environment centered around accomplishing tasks from the standardized elementary science curriculum.
molmospaces
An end-to-end open ecosystem for robot learning
satlas-super-resolution
No description provided for this repository.
ai2-scholarqa-lib
Repo housing the open sourced code for the ai2 scholar qa app and also the corresponding library
satlas
No description provided for this repository.
s2-folks
Public space for the user community of Semantic Scholar APIs to share scripts, report issues, and make suggestions.
scifact
Data and models for the SciFact verification task.
WildBench
Benchmarking LLMs with Challenging Tasks from Real Users
olmoearth_pretrain
Earth system foundation model data, training, and eval
asta-paper-finder
frozen-in-time version of our Paper Finder agent for reproducing evaluation results
real-toxicity-prompts
No description provided for this repository.
discoveryworld
A virtual environment for developing and evaluating automated scientific discovery agents.
hidden-networks
No description provided for this repository.
autodiscovery-neurips
Official code for NeurIPS 2025 paper "AutoDiscovery: Open-ended Scientific Discovery via Bayesian Surprise"
medicat
Dataset of medical images, captions, subfigure-subcaption annotations, and inline textual references
pixmo-docs
ACL 2025: Synthetic data generation pipelines for text-rich images.
discoverybench
Discovering Data-driven Hypotheses in the Wild
SERA
Data generation and training repository for SERA: Soft-Verified Efficient Repository Agents.
satlaspretrain_models
No description provided for this repository.
IFBench
No description provided for this repository.
agent-baselines
No description provided for this repository.
SPECTER2
No description provided for this repository.
bolmo-core
Code for Bolmo: Byteifying the Next Generation of Language Models
wildguard
Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs
aokvqa
Official repository for the A-OKVQA dataset
asta-bench
No description provided for this repository.
S2AND
Semantic Scholar's Author Disambiguation Algorithm & Evaluation Suite
infinigram-api
No description provided for this repository.
DecomP
Repository for Decomposed Prompting
robothor-challenge
RoboTHOR Challenge
MolmoBot
Code and website for "MolmoB0T: Large-Scale Simulation Enables Zero-Shot Manipulation".
rslearn
A tool for developing remote sensing datasets and models.
duplodocus
Tooling for exact and MinHash deduplication of large-scale text datasets
olmoearth_projects
OlmoEarth projects
codenav
CodeNav is an LLM agent that navigates and leverages previously unseen code repositories to solve user queries.
atlantes
Efficient and low latency real-time global-scale GPS trajectory modeling
phone2proc
📱👉🏠 Perform conditional procedural generation to generate houses like your own!
paper-embedding-public-apis
Collection of public APIs for embedding scientific papers
ruletaker
No description provided for this repository.
EMO
No description provided for this repository.
fermi
No description provided for this repository.
artifact-linker
ArtifactLinker: Linking Scientific Artifacts for Automatic State-of-the-Art Discovery
c4-documentation
No description provided for this repository.
signal-and-noise
Measuring the Signal to Noise Ratio in Language Model Evaluation
recoma
Reasoning by Communicating with Agents
persona-bias
No description provided for this repository.
natural-instructions-v1
Benchmarking Generalization to New Tasks from Natural Language Instructions
grobid
A machine learning software for extracting information from scholarly documents
rslearn_projects
No description provided for this repository.
olmo-eval
No description provided for this repository.
twentyquestions
A web application for playing 20 Questions to crowdsource common sense. 🤖
asta-plugins
No description provided for this repository.
MolmoPoint-GUISyn
Synthetic GUI Pointing Data Generation
s6ui
A fast AWS S3 browser, with inspiration from s5cmd
layout-parser
A Python Library for Document Layout Understanding
molmospaces-resources
Resource manager for MolmoSpaces
skiff2-actions
GitHub actions for skiff2 repositories.
OlmoEarth-Feedback
Repo for collection of feedback on OlmoEarth
mujoco
No description provided for this repository.
personalized-scholarqa-eval
Evaluation code for the paper "Language Models Don't Know What You Want: Evaluating Personalization in Deep Research Needs Real Users"
molmospaces_policy_zoo
Policy zoo for data generation + evaluation in MolmoSpaces
fairseq
Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
Frequently asked questions
What does allenai build on GitHub?
Allenai develops open-source software with a focus on artificial intelligence and natural language processing. Notable projects include allennlp for NLP research and OLMo for model training and evaluation.
Which programming languages does allenai use?
Allenai predominantly uses Python for its repositories, alongside other languages like C#, Scala, and Rust. This diverse language usage supports their various AI and machine learning projects.
Are allenai's repositories public?
Yes, all of allenai's repositories are public on GitHub. This openness promotes collaboration and allows others to utilize and contribute to their research and tools in AI.
Is this exposure intended?
Monitor Ai2 with RepoGuard and get alerted the moment a new public repository appears.
Monitor this account