Intel's Deep Learning Boost (DL Boost) is a marketing name for instruction set architecture features on the x86-64 designed to improve performance on deep learning tasks such as training and inference.[1] DL Boost consists of two sets of features:
AVX-512 BF16: lower-precision bfloat16 floating-point numbers for generally faster computation. Operations provided include conversion to/from float32 and dot product.
DL Boost features were introduced in the Cascade Lake architecture.
A TensorFlow-based benchmark run on the Google Cloud PlatformCompute Engine shows improved performance and reduced cost compared to previous CPUs and to GPUs, especially for small batch sizes.[2]
External links
Deep Learning Boost at Intel
Andres Rodrigues et al., "Lower Numerical Precision Deep Learning Inference and Training", Intel White paper [3]
Intel and ML (2017), from Intel's Developer Relations Division
Notes
^"Intel Deep Learning Boost" Product Overview [1], p. 3
^Samantha Gurriero, "Machine Learning Optimisation: What is the Best Hardware on GCP?", Datatonic, [2]
boost, this, article, rely, excessively, sources, closely, associated, with, subject, potentially, preventing, article, from, being, verifiable, neutral, please, help, improve, replacing, them, with, more, appropriate, citations, reliable, independent, third, . This article may rely excessively on sources too closely associated with the subject potentially preventing the article from being verifiable and neutral Please help improve it by replacing them with more appropriate citations to reliable independent third party sources March 2021 Learn how and when to remove this template message Intel s Deep Learning Boost DL Boost is a marketing name for instruction set architecture features on the x86 64 designed to improve performance on deep learning tasks such as training and inference 1 DL Boost consists of two sets of features AVX 512 VNNI 4VNNIW or AVX VNNI fast multiply accumulation mainly for convolutional neural networks AVX 512 BF16 lower precision bfloat16 floating point numbers for generally faster computation Operations provided include conversion to from float32 and dot product DL Boost features were introduced in the Cascade Lake architecture A TensorFlow based benchmark run on the Google Cloud Platform Compute Engine shows improved performance and reduced cost compared to previous CPUs and to GPUs especially for small batch sizes 2 External links EditDeep Learning Boost at Intel Andres Rodrigues et al Lower Numerical Precision Deep Learning Inference and Training Intel White paper 3 Intel and ML 2017 from Intel s Developer Relations DivisionNotes Edit Intel Deep Learning Boost Product Overview 1 p 3 Samantha Gurriero Machine Learning Optimisation What is the Best Hardware on GCP Datatonic 2 This computer hardware article is a stub You can help Wikipedia by expanding it vte Retrieved from https en wikipedia org w index php title DL Boost amp oldid 1096671713, wikipedia, wiki, book, books, library,
