Apple ML Research Introduces RayRoPE for Multi-View Attention
Apple ML Research has proposed RayRoPE, a projective ray positional encoding method for multi-view transformers. RayRoPE encodes image patches uniquely, enables SE(3)-invariant attention with multi-frequency similarity, and adapts to scene geometry by using predicted points along rays rather than just directions, addressing limitations of previous absolute or relative encoding schemes.
Why it matters: RayRoPE could enhance 3D scene understanding and multi-view processing by providing more geometrically aware positional encodings.
Full story at: Apple Machine Learning Research ↗