LLM Ability to Perform iMEC via Toy Logit Simulation

Determine whether current large language models can perform iterative Minimum Entropy Coupling (iMEC) using only simulated logits in a toy autoregressive setting without external tool support.

Background

Information-theoretic steganography via iMEC requires sampling from approximate model logits to embed messages undetectably. The authors report that GPT-4 can compute minimum entropy couplings using code tools, but iMEC requires sufficient logit simulation for sampling.

They explicitly state that they were unable to prompt models to perform iMEC in a toy logit simulation, leaving open whether such capability can be elicited without external tooling.