Lifan Sun’s Blog
Lifan Sun
Article
61
Category
0
Tags
9
Lazy loaded image
Rotatry Positional Encoding
Post on: Mar 20, 2025
Last edited: Jan 29, 2026
Views
NLP
date
slug
status
tags
summary
type
My summary blog on RoPE.
 
  • Author:Lifan Sun
  • URL:stevensun.site/article/rope
  • Copyright:All articles in this blog, except for special statements, adopt BY-NC-SA agreement. Please indicate the source!
Relate Posts
Reading Notes: Qwen Technical Report
Lazy loaded image
Reading Notes Collections: Context Length Extrapolation
Lazy loaded image
Reading Notes: MiniCPM Technical Report
Lazy loaded image
Reading Notes: LLaMA Technical Report
Lazy loaded image
Word Embedding Techniques
Lazy loaded image
Understanding Tokenization Methods
Lazy loaded image
Understanding Tokenization MethodsReading Notes: “FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness”
Loading...
Lifan Sun
Lifan Sun
Software Dev Engineer
Article
61
Category
0
Tags
9
Latest posts
Some Ideas on Research
Some Ideas on Research
Jan 29, 2026
Class Loading in Java
Class Loading in Java
Jan 29, 2026
LLVM IR Tutorial: Phis, GEPs, and other things, oh my! - LLVM Developers Conference 2019
LLVM IR Tutorial: Phis, GEPs, and other things, oh my! - LLVM Developers Conference 2019
Jan 29, 2026
The Elements of Search-Based Software Testing Techniques
The Elements of Search-Based Software Testing Techniques
Jan 29, 2026
Reading Note: “An Industrial Evaluation of Unit Test Generation: Finding Real Faults in a Financial Application”, ICSE-SEIP '17
Reading Note: “An Industrial Evaluation of Unit Test Generation: Finding Real Faults in a Financial Application”, ICSE-SEIP '17
Jan 29, 2026
Reading Note: “Whole Test Suite Generation”, TSE 2012
Reading Note: “Whole Test Suite Generation”, TSE 2012
Jan 29, 2026
2023-2026Lifan Sun.

Lifan Sun’s Blog | Software Dev Engineer

Powered byNotionNext 4.9.2.