Meet Transformer in Transformer: A Visual Transformer That Captures Structural Information From Images

A new paper from Huawei, ISCAS and UCAS researchers proposes a novel Transformer-iN-Transformer (TNT) network architecture that outperforms conventional vision transformers on local information preservation and modelling for visual recognition. Transformer architectures were introduced in 2017, and their computational efficiency and scalability quickly made them the de-facto standard for natural...