Rotatry Positional Encoding | Lifan Sun’s Blog

date

Mar 20, 2025

slug

rope

status

Published

tags

NLP

summary

type

Post

My summary blog on RoPE.

Author:Lifan Sun
URL:stevensun.site/article/rope
Copyright:All articles in this blog, except for special statements, adopt BY-NC-SA agreement. Please indicate the source!

Relate Posts

Reading Notes: Qwen Technical Report

Lazy loaded image

Reading Notes Collections: Context Length Extrapolation

Lazy loaded image

Reading Notes: MiniCPM Technical Report

Lazy loaded image

Reading Notes: LLaMA Technical Report

Lazy loaded image

Word Embedding Techniques

Lazy loaded image

Understanding Tokenization Methods

Lazy loaded image

Understanding Tokenization Methods Reading Notes: “FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness”

Loading...

Lifan Sun

Software Dev Engineer

Latest posts

Class Loading in Java

LLVM IR Tutorial: Phis, GEPs, and other things, oh my! - LLVM Developers Conference 2019

The Elements of Search-Based Software Testing Techniques

Reading Note: “An Industrial Evaluation of Unit Test Generation: Finding Real Faults in a Financial Application”, ICSE-SEIP '17

Reading Note: “Whole Test Suite Generation”, TSE 2012

Reading Note: “Reformulating Branch Coverage as a Many-Objective Optimization Problem”, ICST 2015