Google Technology Equivalents for Ex-Googlers for AI/ML

This repo covers a lot of the technologies and services that Google uses internally to help ex-googlers survive the real world.

This repo further extend a handy lookup table of similar technology and services to help ex-googlers to build AI/ML :)

pull-requests are very welcomed. Please do not list any confidential projects!

AI/ML Stacks

Foundation Models (LLM/VLM, Image Generation, Video Generation, etc.)

Google Internal	Google External	Open Source / Real-World
Gemini	Gemma	OpenAI ChatGPT, Anthropic Claude, Meta LLaMA, Mixtral
Imagen 3		DALL-E 3, stable diffusion
Veo		Sora, Open-Sora, runway, pika, Mochi
		OpenAI Realtime, moshi

Data Curation Pipeline

Google Internal	Google External	Open Source / Real-World
Flume	DataFlow	Apache Beam, Apache Spark, DataChain

Data loader

Google Internal	Google External	Open Source / Real-World
tfds, grain	tfds, grain	torchdata, datasets

Experiment Management and hyperparameter tuning

Google Internal	Google External	Open Source / Real-World
xmanager	xmanager	wandb, mlflow, dvc, tensorboard, slurm, ray, skypilot
vizier	vizier	autogluon

Training

Google Internal	Google External	Open Source / Real-World
Pre-training		transformers, composer, ms-swift, unsloth
Post-training		trl, OpenRLHF, verl, Open-Reasoner-Zero

Inference/Serving stacks

Google Internal	Google External	Open Source / Real-World
		vllm, sglang, TensorRT-LLM

Inference/Serving Platforms

Google Internal	Google External	Open Source / Real-World
		Lepton, Modal, Firework

Evaluation

Google Internal	Google External	Open Source / Real-World
		evals

Infrastructure

Google Internal	Google External	Open Source / Real-World
TensorFlow, Jax, Flax, optax, orbax, ConfigDict	TensorFlow, Jax, Flax, optax, orbax, ConfigDict	pytorch
Pallas	Pallas	Triton

Tools

Google Internal	Google External	Open Source / Real-World
LLM Agent		swarm, crewai, autogen
LLM Graph		langgraph
LLM Programming		dspy
OneTwo		langchain

Visualization

Google Internal	Google External	Open Source / Real-World
		streamlit, gradio, altair, bokeh

disclaimer: I'm not affiliated with any of the technologies/products mentioned above.

disclaimer: I recently left Google so some of the naming might be dated.