date
Jan 28, 2025
slug
moores-law-and-future
status
Published
tags
MLSys
summary
type
Post
The End of Moore’s Law
- The performance increase brought by integrating more transistors has come to a plateau in 2025.
Future: heterogeneous architecture & computing
three paradigm in heterogeneous computing:
- hardware-driven algorithm design: design algorithm to make the best of the hardware
- algorithm-driven hardware design: design hardware for specific workload
- algorithm-hardware co-design
- Author:Lifan Sun
- URL:stevensun.site/article/moores-law-and-future
- Copyright:All articles in this blog, except for special statements, adopt BY-NC-SA agreement. Please indicate the source!
Relate Posts
CS336 Assignment 1 Key Takeaway
Reading Notes: “DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving”
Reading Notes: “Preble: Efficient Distributed Prompt Scheduling for LLM Serving”
Reading Note: “ORCA: A Distributed Serving System for Transformer-Based Generative Models”
Reading Notes: “FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness”
Reading Notes: “Efficient Memory Management for Large Language Model Serving with PagedAttention”
