Lifan Sun’s Blog
About Me
Category
Tags
Lifan Sun
Article
62
Category
0
Tags
9
About Me
Category
Tags
Lazy loaded image
Rotatry Positional Encoding
Post on: Mar 20, 2025
Last edited: Feb 13, 2026
Views
NLP
date
Mar 20, 2025
slug
rope
status
Published
tags
NLP
summary
type
Post
My summary blog on RoPE.
 
  • Author:Lifan Sun
  • URL:stevensun.site/article/rope
  • Copyright:All articles in this blog, except for special statements, adopt BY-NC-SA agreement. Please indicate the source!
Relate Posts
Reading Notes: Qwen Technical Report
Lazy loaded image
Reading Notes Collections: Context Length Extrapolation
Lazy loaded image
Reading Notes: MiniCPM Technical Report
Lazy loaded image
Reading Notes: LLaMA Technical Report
Lazy loaded image
Word Embedding Techniques
Lazy loaded image
Understanding Tokenization Methods
Lazy loaded image
Understanding Tokenization MethodsReading Notes: “FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness”
Loading...
Lifan Sun
Lifan Sun
Software Dev Engineer
Article
62
Category
0
Tags
9
Latest posts
Class Loading in Java
Class Loading in Java
Feb 13, 2026
LLVM IR Tutorial: Phis, GEPs, and other things, oh my! - LLVM Developers Conference 2019
LLVM IR Tutorial: Phis, GEPs, and other things, oh my! - LLVM Developers Conference 2019
Feb 13, 2026
The Elements of Search-Based Software Testing Techniques
The Elements of Search-Based Software Testing Techniques
Feb 13, 2026
Reading Note: “An Industrial Evaluation of Unit Test Generation: Finding Real Faults in a Financial Application”, ICSE-SEIP '17
Reading Note: “An Industrial Evaluation of Unit Test Generation: Finding Real Faults in a Financial Application”, ICSE-SEIP '17
Feb 13, 2026
Reading Note: “Whole Test Suite Generation”, TSE 2012
Reading Note: “Whole Test Suite Generation”, TSE 2012
Feb 13, 2026
Reading Note: “Reformulating Branch Coverage as a Many-Objective Optimization Problem”, ICST 2015
Reading Note: “Reformulating Branch Coverage as a Many-Objective Optimization Problem”, ICST 2015
Feb 13, 2026
2023-2026Lifan Sun.

Lifan Sun’s Blog | Software Dev Engineer

Powered byNotionNext 4.9.3.