ChemCrow: Augmenting large-language models with chemistry tools
Andres M Bran, Sam Cox, Andrew Dickson White, Philippe Schwaller, White, Andrew D, Schwaller, Philippe
Paper appears method- or tooling-adjacent to AI workflows with partial ecosystem coverage.
Over the last decades, excellent computational chemistry tools have been developed. Integrating them into a single platform with enhanced accessibility could help reaching their full potential by overcoming steep learning curves. Recently, large-language models (LLMs) have shown strong performance in tasks across domains, but struggle with chemistry-related problems. Moreover, these models lack access to external kno ...
wledge sources, limiting their usefulness in scientific applications. In this study, we introduce ChemCrow, an LLM chemistry agent designed to accomplish tasks across organic synthesis, drug discovery, and materials design. By integrating 18 expert-designed tools, ChemCrow augments the LLM performance in chemistry, and new capabilities emerge. Our agent autonomously planned and executed the syntheses of an insect repellent, three organocatalysts, and guided the discovery of a novel chromophore. Our evaluation, including both LLM and expert assessments, demonstrates ChemCrow's effectiveness in automating a diverse set of chemical tasks. Surprisingly, we find that GPT-4 as an evaluator cannot distinguish between clearly wrong GPT-4 completions and Chemcrow's performance. Our work not only aids expert chemists and lowers barriers for non-experts, but also fosters scientific advancement by bridging the gap between experimental and computational chemistry.
Results & Benchmarks
No concrete benchmark grounding is available yet. Treat the page as context or an implementation starting point only.
Over the last decades, excellent computational chemistry tools have been developed.
Implementation Evidence Summary
Recommendation evidence is currently too limited for a maintained-repo choice. Use Implementation Status and Reproduction Path for a practical baseline plan.
Reproduction Risks
- Estimate is based on paper-only reproduction flow
Hardware Notes
Expect multi-day setup/compute for meaningful reproduction based on current guidance.
Evidence disclosure
Evidence graph: 2 refs, 1 links.
Utility signals: depth 65/100, grounding 58/100, status medium.
Implementation Status
There is no verified maintained implementation yet. Use this baseline plan to decide whether to prototype now or defer.
- No direct maintained implementation was found. Use the paper PDF and citation graph to design a baseline reproduction.
- Start from related paper: The Art of Bridging.
- Track assumptions and missing details in an experiment log before coding.
Reproduction readiness
Hardware requirements
- Expect multi-day setup/compute for meaningful reproduction based on current guidance.
No verified implementation available
- · No maintained repository has been identified for this paper. Check adjacent implementations or HF artifacts below.
No benchmark numbers could be verified. You will not be able to validate reproduction correctness against published numbers.
Hugging Face artifacts
No trustworthy direct or curated related Hugging Face artifacts were found yet.
Continue with targeted Hugging Face searches derived from the paper title and method context:
Models
Datasets
Spaces
Tip: start with models, then check datasets/spaces if you need evaluation data or demos.
Direct artifact matches are currently sparse. Use targeted Hugging Face searches to quickly locate candidate models, datasets, and demos.
Research context
132
Citations
0
References
Tasks
Limiting, Bridging (networking), Computer science, Set (abstract data type), Drug discovery, Data science, Nanotechnology, Materials Science
Methods
Transformer
Domains
Chemistry, Artificial intelligence, Materials Chemistry
Evaluation & Human Feedback Data
Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.
Open in HFEPXExplore Similar Papers
Jump to Paper2Code search queries derived from this paper's research context.
Related papers
-
Search on Paper2Code
The Art of Bridging (2023) Semantic similarity
-
Search on Paper2Code
Testing for Bridging Faults (2009) Semantic similarity
-
Search on Paper2Code
Bridging the Divide: Part 2 – Science Bridging Units (2008) Semantic similarity
-
Search on Paper2Code
Some considerations of bridging stresses for fiber-reinforced ceramics (1991) Semantic similarity
-
Search on Paper2Code
Bridging the gap between science and politics—The role of precaution in chemicals control (2006) Semantic similarity
-
Search on Paper2Code
OS1322-394 Fracture mechanism of intralaminar crack propagation under mode II loading for CFRP laminates (2015) Semantic similarity
Need human evaluators for your AI research? Scale annotation with expert AI Trainers.