Close Menu
  • AI
  • Content Creation
  • Tech
  • Robotics
AI-trends.todayAI-trends.today
  • AI
  • Content Creation
  • Tech
  • Robotics
Trending
  • Anthropic Sought Limits on IPO Deal Groups and Work with Rivals – Unite.AI
  • Banks Have Had It As much as Right here With Your AI Agent
  • Greatest Private AI Brokers in 2026: OpenClaw, Hermes Agent, Gemini Spark and Extra, In contrast on Reminiscence, Safety and Price
  • CrowdStrike Reportedly in Talks to Purchase AI Safety Associate Zscaler – Unite.AI
  • Tesla Rolls Out FSD V15 with Actuality View and Imaginative and prescient Upgrades – Unite.AI
  • Potential Cognition AI Spherical Would Elevate $2B-Plus at $75B Valuation – Unite.AI
  • OpenRouter Cuts Three Suppliers After AI Immediate Publicity Findings – Unite.AI
  • A Group of Researchers from Columbia and CertiK Introduce TensorLean for Formal Verification of GPU Kernels
AI-trends.todayAI-trends.today
Home»Tech»Google AI introduces TabFM, a hybrid-attention tabular foundation model for zero-shot classification and regression

Google AI introduces TabFM, a hybrid-attention tabular foundation model for zero-shot classification and regression

Tech By Gavin Wallace01/07/20269 Mins Read
Facebook Twitter LinkedIn Email
NVIDIA AI Introduces AceReason-Nemotron for Advancing Math and Code Reasoning
NVIDIA AI Introduces AceReason-Nemotron for Advancing Math and Code Reasoning
Share
Facebook Twitter LinkedIn Email

Google Research introduced TabFMThe foundation model is built to handle tabular data. TabFM is able to perform both classification and regression, without the need for dataset-specific learning. The model makes every prediction from one forward pass. The model frames tabular predictions as in-context problems. This model is currently available at Hugging Face, GitHub.

TL;DR

  • TabFM is able to predict the outcome of a game on a table that has not been seen. This requires no tuning, training or engineering.
  • In-Context Learning is used to predict the results after reading all of the datasets.
  • TabICL is an in-context, row/column learning architecture that combines TabPFN’s style of attention to rows and columns with TabPFN’s style of row/columns.
  • The training uses hundreds of millions synthetic datasets derived from structural causal models.
  • Google BigQuery is exposing TabFM via an AI.PREDICT SQL Command soon.

What is TabFM?

Tables are the foundation of any enterprise’s data infrastructure. Tables can be used to perform tasks such as detecting fraud and customer churn. Tree-based methods have dominated the space for years. XGBoost and AdaBoost provided robust results for structured data. Google presents TabFM as a tabular version of TimesFM, the zero-shot model for time series.

This reliability came at a price. Fitting XGBoost onto a brand new dataset can be a challenge. .fit() call. Data scientists work for hours optimizing hyperparameters and engineering features. These data scientists do all this to obtain a trustworthy signal out of raw data. TabFM targets this bottleneck.

TabFM follows the logic of large language model zero-shot. LLMs can learn to perform new tasks by using in-context example without changing any weights. The technique used is known as in-context (or ICL). TabFM takes the idea and applies it to tables. In one single pass, it generates all predictions.

It Works

TabFM skips this step entirely. TabFM completely skips this step. TabFM uses the entire dataset in a single, unified prompt. This prompt contains both target rows and training examples. At inference, the model can read column-row relationships.

Text is not a table. The tables are inherently two-dimensional. The meaning of the sentences is not altered by swapping two rows or columns. Instead, standard language models handle one-dimensional ordered sequences. TabFM is a synthesized TabPFN/TabICL hybrid designed to bridge this gap.

The system relies on 3 mechanisms:

  • Attention to alternate row and column: A multilayer module of attention processes the raw table. TabPFN switches attention between rows and columns. The contextualization is very detailed and captures all the interactions between features. This tool automates tasks that require manual work.
  • Row Compression: The information from each row that is cross-attended compresses to a dense vector.
  • In-context learning: These compressed embeddings will be run over by a Transformer. TabICL’s attention to the compressed rows reduces computation costs dramatically. The prediction is still efficient on very large datasets.

Training on synthetic data at scale

Foundation models need vast, diverse data. In the world of open source, it is difficult to find high-quality datasets. The tables in industrial settings contain sensitive and proprietary information. They are therefore not accessible to a wide range of pre-training.

You can generate tables of any size. Google’s researchers call them the best option for this size. TabFM uses hundreds of thousands of synthetic datasets to train. The datasets are dynamically generated using structural causal model (SCMs). The random functions are varied in each. This approach is able to capture the complex relationships and distributions found in actual tables. Researchers report that the model is generalizable to real data not seen before.

Performance Benchmarking

The TabArena team evaluated TabFM. TabArena, a benchmark for live games that calculates Elo from win rates in head-to-head matches, is an example of a living benchmark. This evaluation covers 38 datasets for classification and 13 datasets for regression. Sample sizes vary from 700 up to 150,000.

We tested two configurations. Plain TabFM works out of the box in one forward pass. No tuning or cross validation is required. TabFM-Ensemble includes SVD and cross features. The program computes the optimal weights of a 32 way ensemble by using a solver that does not use negative least squares. This software also uses Platt scale as a calibration for the classification.

TabFM outperforms industry standard algorithms, according to the research team. The GitHub page contains full per-fold statistics and win rates.

Aspect Traditional GBDT TabFM TabFM-Ensemble
Dataset-specific training You are Required No (In-Context Learning) No,
Hyperparameter tuning Manual No, Ensemble weights via NNLS
Feature engineering Manual, domain-specific You can learn by paying attention Cross + SVD now available
Prediction Following full training Single forward pass 32-way ensemble
Calibration Manual (optional). — Platt scaling (classification)

Get Started with Installation and Code

The repository is cloned and installed locally. This base installation uses CPU-only JAX. The Base Install uses only CPU-based JAX. Cuda Additional pulls the CUDA 12 plug-in and NVIDIA Libraries for GPU runs.

Specific requirements apply to core functions. Python 3.11 is required. You need Python 3.11 or later. jax==0.10.1 The following are some examples of how to get started: flax==0.12.7The modern flax.nnx API. Downloading the weights pre-trained automatically is possible with Hugging Face Hub.

Import numpy as an np
import pandas as pd
Tabfm import tabfm_v1_0_0
TabFMClassifier import from Tabfm

TabFM pre-trained v1.0.0 can be downloaded from the Hugging Face website.
model = tabfm_v1_0_0.load()

# scikit-learn compatible classifier
clf = TabFMClassifier(model=model)

X_train = pd.DataFrame({
    "age": [25.0, 45.0, 35.0, 50.0],
    "job": ["engineer", "manager", "engineer", "manager"],
    "income": [80000, 120000, 90000, 130000]
})
y_train = np.array(["low_risk", "high_risk", "low_risk", "high_risk"])

X_test = pd.DataFrame({
    "age": [30.0, 48.0],
    "job": ["engineer", "manager"],
    "income": [85000, 125000]
})

clf.fit(X_train, y_train)
prediction = clf.predict()
probabilities = clf.predict_proba(X_test)

print("Predictions:", predictions)
print("Class Probabilities:n", probabilities)

You can find out more about this by clicking here. You can also fit() It prepares numerical and ordinal scalers. The model does not learn weights from your data. This pattern is mirrored by the regressor. TabFMRegressor The following are some examples of how to get started: reg.predict().

Use Cases with Examples

APIs can be used to perform common prediction tasks. In the context of customer retention, past customers are labeled as retained or churned. TabFM measures churn risks for new clients in a single pass.

Age, employment, and income are all factors that can be used to assess credit risk. Labels indicate low_risk The following are some examples of how to use high_riskThe sample code is an example. The new applicant is scored immediately without any training.

House price predictions are a good fit for regression. The context rows include square footage, neighborhood and other information. TabFM provides a price prediction for listings that have not yet been seen.

Interactive Explainer


AI ar ces dat Google
Share. Facebook Twitter LinkedIn Email
Avatar
Gavin Wallace

Related Posts

Greatest Private AI Brokers in 2026: OpenClaw, Hermes Agent, Gemini Spark and Extra, In contrast on Reminiscence, Safety and Price

22/11/2026

A Group of Researchers from Columbia and CertiK Introduce TensorLean for Formal Verification of GPU Kernels

22/11/2026

OpenAI Ships GPT-Stay-1.1 for Voice Brokers, Cuts Idle Value to $0.02/Min

21/11/2026

Meet Pondering Machines Inkling 2 Mini: 26B Looped MoE Runs on a 32GB Mac

21/11/2026
Top News

The AI assistant wants to make up for your boyfriend’s incompetence

The AlphaGo Man Thinks AI’s Going the Wrong Way

Mathematicians Hate AI. They Can’t Give up It

The AI thinks so. AI thinks so

OpenAI Desires Its New Agent to Run Your Life. Mine Stated It Cherished Me

Load More
AI-Trends.Today

Your daily source of AI news and trends. Stay up to date with everything AI and automation!

X (Twitter) Instagram
Top Insights

OpenAI’s Widened Probe Turns Up More Agent Escapes – Unite.AI

31/07/2026

OpenAI Releases GPT 5.1-Codex Max, an Agentic Coding model with Compaction and Long Horizons for Workflows in Multi-Window.

20/11/2025
Latest News

Anthropic Sought Limits on IPO Deal Groups and Work with Rivals – Unite.AI

22/11/2026

Banks Have Had It As much as Right here With Your AI Agent

22/11/2026
X (Twitter) Instagram
  • Privacy Policy
  • Contact Us
  • Terms and Conditions
© 2026 AI-Trends.Today

Type above and press Enter to search. Press Esc to cancel.