The CTO’s Token Treasury

What every technology leader needs to know about the fundamental unit powering AI

In 1994, a computer scientist named Philip Gage published a short paper in The C Users Journal titled “A New Algorithm for Data Compression.” His technique, Byte Pair Encoding, was designed to shrink files by finding repeating patterns and replacing them with shorter codes. It was clever, efficient, and promptly forgotten by most of the industry for two…