Home/ What is an AI factory
What is an
AI factory?
A building designed around one job: running the computers that train and operate artificial intelligence. The name is borrowed from manufacturing, because it works like a production line that never stops.
01A word with two meanings
Careful: "AI factory" is used in two different ways.
1. The industry term
Popularised by the chip maker NVIDIA. Any computing site built to take in data, train models and answer questions at volume. Output is measured in tokens per second and tokens per unit of energy.[10] Anyone may use the phrase this way.
02The difference
An ordinary data centre stores and serves. An AI factory calculates.
Ordinary data centre
Holds data, serves it, moves it. What comes out is what went in.
AI factory
Takes data in, trains a model on it, improves it, then runs it to produce answers and predictions.[10]
Power drawn by a single cabinet, drawn to scale.[12]
| Ordinary data centre | AI factory | |
|---|---|---|
| Runs | Websites, email, databases, business software | Model training, then answering requests at volume |
| Cooling | Air, up to about 20 kW[12] | Liquid at the chip, standard by 120 to 130 kW[12] |
| Load pattern | Rises and falls with the working day | Near full load for days or weeks |
| Main processor | General purpose CPUs | GPUs working in large groups[10] |
| Measured by | Uptime, storage, bandwidth | Output per second, output per unit of energy[10] |
A normal data centre is a library. An AI factory is a foundry.
03What is inside
Seven parts. Get any one of them wrong and the rest is useless.
Power
A grid connection large enough and steady enough. Usually the hardest part to arrange, because capacity is granted by the network operator and can take years. The figure quoted for a site, such as 31.5 MW at Hüüru, is the ceiling for the whole campus.[3]
Cooling
Nearly all the electricity a computer uses turns into heat. Remove it too slowly and the chips throttle themselves. Plain air stops being enough past roughly 20 kilowatts per cabinet, and by the 120 to 130 kilowatts a current AI rack draws, the industry runs coolant straight to the chips.[12] This is the biggest physical change when a data centre is converted for AI.
The chips
Graphics processors and similar accelerators, good at doing the same sum across enormous amounts of numbers at once. They are usually not owned by the building: the operator provides space, power, cooling and network, and the customer installs the hardware.[3]
The network inside
Thousands of chips on one problem must constantly exchange results. If the internal wiring is slow, expensive chips sit idle waiting for each other.[10]
Storage and data
Training means reading very large amounts of data over and over, fast enough to keep the chips busy.[10] This is also where the legal question lands, because the physical location of the storage decides whose rules apply.
04Plain words
The words you will hear, without the jargon.
Megawatt (MW)
How much electricity is being used at any moment. The size of the tap, not the size of the bucket.
Terawatt hour (TWh)
How much electricity was used over time. That is the bucket. The world's data centres used 415 TWh during 2024.[11]
PUE
Total building electricity divided by the electricity that reaches the computers. 1.5 means half as much again goes on cooling and losses. Lower is better.
GPU
A chip built to draw video game images, which turned out to suit AI: both jobs repeat one calculation across huge numbers of values.
Token
The unit an AI model reads and writes, usually a word or part of one. NVIDIA measures an AI factory's output in tokens, the way a mill measures tonnes.[10]
Colocation
Renting space, power and cooling for your own computers. The customer owns the machines, the operator owns the building.
Carrier neutral
The building does not force you to buy connectivity from one company. Customers can choose, and can switch.[3]
Sovereign compute
Capacity that sits inside one legal area, so only that area's laws and courts govern the data on it. Legal control, not national pride.