rotary-embedding-torch

Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch

Project.

Catalog snapshot

License: MIT
Platforms: Linux
Docker: No
Commercial use: Allowed
Stars: 824
Language: Python
Last commit: Jun 20, 2026
Tags: artificial-intelligencedeep-learningpositional-encoding

Repository health snapshot: 67 forks and 21 open issues at review time. Platform support is inferred conservatively from repository topics.

About.

Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch Fossfits includes rotary-embedding-torch as an actively maintained vector db option: its public repository was updated on 2026-06-20, uses the MIT license, and had 824 stars when reviewed. Check its documentation and release notes before production adoption.

artificial intelligence · deep learning · positional encoding

Nearby.

All Vector databases

TtxtaiAll-in-one Python framework for embeddings, vector search, and RAG workflows.Compare
QQdrantRust vector database with filters, payloads, and a REST API.Compare
WWeaviateVector database with hybrid search and modular vectorizers.Compare
MMilvusCloud-native vector database built for large-scale ANN search.Compare
CChromaDeveloper-friendly embedding database for local RAG prototypes.Compare