When stamps were first issued, they had no gum on the back.  And if paste was not available, mailers sometimes pinned or even sewed stamps to envelopes.