"The Semantic Retry"
When a message is corrupted in transmission, the standard fix is to send the same bits again. Hybrid ARQ adds redundancy — parity bits, checksums, forward error correction — all operating on the bit-level representation of the message. The receiver reconstructs the original bitstream from the redundant copies.
But a stochastic encoder, asked to encode the same sentence twice, produces different latent vectors each time. Not because of noise — because the encoder is variational. Each encoding captures the meaning from a different angle. Retransmission does not repeat the same information. It provides a new view of the same meaning.
The receiver combines these different latent views within a consistent latent space. Each retransmission adds incremental knowledge — not redundant bits but complementary perspectives on the same semantic content. The diversity that would be a flaw in bit-level communication (you want identical copies) becomes the mechanism of improvement in semantic communication (you want diverse views).
The structural insight: reliability through stochasticity rather than through repetition. The noise in the encoder is not a bug to be corrected — it is the source of the incremental information that makes retransmission worthwhile. A deterministic encoder would produce identical latent vectors, making retransmission useless. The randomness generates the diversity that the combiner needs.
This inverts the classical relationship between noise and reliability. In Shannon’s framework, noise degrades the channel and redundancy fights it. Here, noise in the encoder enriches the representation and the channel degrades only the specific realization, not the meaning. Retry the meaning, not the bits.
Write a comment