The explosive growth of AI processing in data center and edge environments has induced AI startups and established firms alike to develop silicon to handle the massive processing demands of neural networks. Inference processing, in particular, is an emerging opportunity, wherein a trained deep neural network is processed to predict characteristics of new data samples. This processing is typically performed on CPUs. However, that situation will have to change to handle the exponential growth in model size and new applications that depend on multiple neural networks to solve complex problems. We believe that the market for inference processing will exceed that of data center AI training in 3-4 years, surpassing $5B in annual chip sales by 2025.
You can download the paper by clicking on the logo below:
Table Of Contents:
- Introduction
- Tenstorrent's Holistic Strategy
- Tenstorrent Product Roadmap
- Conclusions: The Holistic Approach Holds Tremendous Promise And Challenges
- Figure 1: Tenstorrent Grayskull Processing Element (Single Core)
- Figure 2: Packet Manager
- Figure 3: O(N) Matrix Multiplication
- Figure 4: ML vs Moore's Law (Optimistic)
- Figure 5: Flexible Scheduling & Parallelization
- Figure 6: Tenstorrent Silicon Roadmap
- Table 1: 65W Grayskull BERT Inference Performance
Companies Cited
- AMD
- Graphcore
- NVIDIA
- OpenAI
- Qualcomm
- Tenstorrent
Patrick founded the firm based on his real-world world technology experiences with the understanding of what he wasn’t getting from analysts and consultants. Ten years later, Patrick is ranked #1 among technology industry analysts in terms of “power” (ARInsights) in “press citations” (Apollo Research). Moorhead is a contributor at Forbes and frequently appears on CNBC. He is a broad-based analyst covering a wide variety of topics including the cloud, enterprise SaaS, collaboration, client computing, and semiconductors. He has 30 years of experience including 15 years of executive experience at high tech companies (NCR, AT&T, Compaq, now HP, and AMD) leading strategy, product management, product marketing, and corporate marketing, including three industry board appointments.
