ByteTransformer

library
ByteDance
High-performance Transformer implementation optimized for variable-length sequences.
GitHubPaper (arXiv)

Library

GitHub Repository

infrastructure

Notes

Published at IEEE IPDPS 2023.