variables: 935637

This table contains all the variables of all the datasets we have at Our World In Data. Note that this includes only the information about the variables like name and default display settings, not the data itself.

Data license: CC-BY

This data as json

id name unit description createdAt updatedAt code coverage timespan datasetId sourceId shortUnit display columnOrder originalMetadata grapherConfigAdmin shortName catalogPath dimensions schemaVersion processingLevel processingLog titlePublic titleVariant attributionShort attribution descriptionShort descriptionFromProducer descriptionKey descriptionProcessing licenses license grapherConfigETL type sort dataChecksum metadataChecksum
935637 Training computation (petaFLOP) petaFLOP   2024-06-19 14:36:00 2024-07-08 16:38:43       6571     
{
    "unit": "petaFLOP",
    "zeroDay": "1949-01-01",
    "yearIsDay": true,
    "numDecimalPlaces": 0
}
 0     training_computation_petaflop grapher/artificial_intelligence/2024-06-19/epoch_compute_intensive/epoch_compute_intensive#training_computation_petaflop   2 major           Computation is measured in total petaFLOP, which is 10¹⁵ [floating-point operations](#dod:flop) estimated from AI literature, albeit with some uncertainty.   
[
    "In the context of artificial intelligence (AI), training computation is predominantly measured using floating-point operations or \u201cFLOP\u201d. One FLOP represents a single arithmetic operation involving floating-point numbers, such as addition, subtraction, multiplication, or division. To adapt to the vast computational demands of AI systems, the measurement unit of petaFLOP is commonly used. One petaFLOP stands as a staggering one quadrillion FLOPs, underscoring the magnitude of computational operations within AI.",
    "Modern AI systems are rooted in machine learning and deep learning techniques. These methodologies are notorious for their computational intensity, involving complex mathematical processes and algorithms. During the training phase, AI models process large volumes of data, while continuously adapting and refining their parameters to optimize performance, rendering the training process computationally intensive.",
    "Many factors influence the magnitude of training computation within AI systems. Notably, the size of the dataset employed for training significantly impacts the computational load. Larger datasets necessitate more processing power. The complexity of the model's architecture also plays a pivotal role; more intricate models lead to more computations. Parallel processing, involving the simultaneous use of multiple processors, also has a substantial effect. Beyond these factors, specific design choices and other variables further contribute to the complexity and scale of training computation within AI."
]
 Training computation was converted from its original measurement in FLOPs (floating-point operations) to a more manageable unit known as petaFLOPs. This conversion is performed by dividing the original training compute value by 1e15, which represents one quadrillion (10^15). The purpose of this conversion is to provide a more human-readable and practical representation of the immense computational efforts involved in training AI systems. By expressing the training computation in petaFLOPs, it becomes easier to grasp the scale and magnitude of the computational resources required for training these systems, especially when dealing with large datasets and complex architectures.     
{
    "note": "Confirmed large-scale AI models are those where the training compute exceeds 10\u00b2\u00b3 floating-point operations (FLOP).",
    "title": "Training computation"
}
 float 
[]
 cc4703e34ef1b579bb10f61ae22f936b db56ac11e8f4cd8f006ac9ad4afe4f22

Links from other tables