Relative Entropy, Distinguishability, and Recovery

Relative entropy compares two states using the observables available in a specified algebra. It connects continuum state comparison to distinguishability, lost information, and recovery, with operational conclusions depending on the allowed tasks and resources.

Enter this chapter

Begin with Relative Entropy for QFT States to define relative entropy on a chosen algebra and reference state.

Helpful background. Review restricted local states, regulated subregion entropy, operator algebras and positive functionals, Markov semigroups, and trace ideals as needed.

Topics

1. Relative Entropy for QFT States — Introduces algebraic relative entropy and its support conditions.
2. Araki Relative Entropy and Regulated Limits — Relates algebraic comparison to controlled regulated approximations.
3. Positivity, Monotonicity, and Data Processing — Derives how restriction and channels reduce distinguishability.
4. Hypothesis Testing and Asymptotic Distinguishability — Connects state comparison to asymptotic binary testing.
5. Fidelity, Chernoff Bounds, and State Overlap — Separates fidelity, overlap, and Chernoff testing quantities.
6. Operational Distinguishability and Continuity Bounds — Bounds discrimination using the allowed measurements.
7. Mutual Information and Regulator-Independent Correlations — Defines total correlation through joint and product-state comparison.
8. Strong Subadditivity and Entropic Inequalities — Connects entropy inequalities to data processing.
9. Conditional Mutual Information and Quantum Markov Structure — Measures conditional correlation and exact Markov structure.
10. Recovery Maps and Approximate Markovianity — Relates small conditional information to approximate recovery.
11. Petz, Rotated, and Universal Recovery Maps — Constructs transpose and rotated recovery maps with their domains.
12. Infinite-Dimensional and Energy-Constrained Channel Distances — Restricts channel comparisons to specified energy resources.
13. Information-Measure Domain and Comparison Atlas — Matches an information measure to its mathematical and operational domain.

How the ideas fit together

Restricting two faithful normal states to a subalgebra cannot increase relative entropy. When the original relative entropy is finite, equality is tied to a map that recovers both states Petz 1986, Theorem 4, pp. 127–128. This connects distinguishability with exact recovery. Approximate recovery bounds and channel versions require their own domain assumptions and theorems; a small chosen correlator alone does not establish a decoder.

Continuum algebras need not have density matrices, and unrestricted channel distances can be dominated by arbitrarily energetic inputs. Algebra, reference support, and energy domain must therefore remain fixed when translating a bound into a discrimination or recovery claim.

The comparison below separates the assumptions and tests needed for these different conclusions.

What the chapter establishes

Information measures, operational tasks, and claim boundaries

Quantity	Domain	Topology or norm	Regulator status	Operational task	Theorem hypotheses	Equality case	Error or bound	Counterexample or failed control
Araki relative entropy S(ω‖φ)	Normal states on one von Neumann algebra; extended value +∞ is allowed	Standard-form relative modular operator; no ambient trace is required	Intrinsic target; type-I or lattice values need compatible embeddings and convergence	Asymmetric comparison with a reference; Stein rate when a separate iid theorem applies	Same algebra and state order; support inclusion is necessary, not sufficient, for a finite value in infinite dimensions	S=0 exactly for equal states	Data processing contracts S under a declared physical restriction or channel	Subtracting divergent local entropies, or comparing states on unmatched algebras, does not define this quantity
Regulated von Neumann entropy SΛ(ρA)	A density operator on one finite-dimensional, regulator-defined type-I subsystem A	Spectral trace functional −Tr ρA ln ρA; it is not a state-distance topology	Regulator dependent; only a complete subtraction, combination, or controlled limit can define a continuum quantity	Quantify mixedness, and entanglement for a pure regulated bipartition	Normalized ρA; finite dA≥2, tensor factor, center or edge prescription, logarithm base, and common regulator are fixed	For a pure regulated bipartite state, SΛ(A)=SΛ(Ā); SΛ=0 exactly when ρA is pure	For common dA and T=‖ρ−σ‖1/2≤1−1/dA, |ΔS|≤T ln(dA−1)+h2(T); also 0≤SΛ≤ln dA	A sharp type-III region has no such reduced density matrix; changing the cutoff, tensor factor, center, or edge modes changes the entropy
Smooth support min-relative entropy Dminε	A finite-dimensional state pair, with the optimized state allowed to be normalized or subnormalized as declared	Support divergence −ln Tr(Πρ̃σ), maximized over one declared trace- or purified-distance ε-ball	State space, smoothing metric, normalization convention, ε, logarithm base, and cutoff remain fixed	One-shot support overlap and zero-type-I asymmetric testing, with a controlled approximation	For Dmin=DH0, ρ and σ are normalized, Tr(Qρ)≥1, and the log base and state order agree; a smooth identity is not implied	At ε=0 it reduces to the support Dmin; with the stated normalized testing convention this equals DH0	ε is a metric radius, not a type-I error probability; any comparison bound must translate metric, normalization, and log base	Switching from trace to purified distance, or from normalized to subnormalized smoothing, changes the feasible set and boundary terms
Smooth max-relative entropy Dmaxε	A finite-dimensional state pair, with the optimized state allowed to be normalized or subnormalized as declared	Smallest domination exponent ρ̃≤eλσ, minimized over one declared trace- or purified-distance ε-ball	State space, smoothing metric, normalization convention, ε, logarithm base, and cutoff remain fixed	One-shot domination and resource-conversion bounds formulated in the chosen smoothing convention	Support of every finite candidate lies in the support of σ; the theorem uses the same smoothing ball and state normalization	At ε=0 it reduces to Dmax; for normalized states Dmax=0 exactly when ρ=σ	The optimizer certifies ρ̃≤eDmaxεσ; ε controls approximation, not operational failure by itself	Support leakage makes the unsmoothed value +∞; with subnormalized smoothing it can be negative, so an undeclared convention can hide the singularity
Relative-entropy variance V(ρ‖σ)	A finite-dimensional ordered state pair with supp ρ⊆supp σ for the iid theorem stated here	ρ-weighted centered second moment of log ρ−log σ, in nats² (bits² for base-two logs); it is neither a divergence nor a norm	The state pair, cutoff, copy model, and logarithm convention remain fixed before n→∞	Second-order √n correction to asymmetric iid hypothesis testing	Independent tensor powers, collective tests, fixed 0<ε<1, and support inclusion; the nondegenerate Gaussian term additionally needs 0<V<∞	V=0 exactly when (log ρ−log σ−D)√ρ=0; then the Gaussian √n term degenerates	DHε(ρ⊗n‖σ⊗n)=nD+√(nV) Φ−1(ε)+O(ln n) under the stated hypotheses	Correlated replicas, failed support inclusion, infinite or zero variance, or a moving regulator invalidates the Gaussian expansion
Hypothesis-testing divergence DHε	Two states and effects on one declared test algebra	Optimization over effects 0≤Q≤1 at fixed type-I error tolerance ε	Detector algebra, copy model, ε, energy set, and cutoff remain fixed	One-shot asymmetric binary decision; iid Stein and second-order analysis	Independent copies and collective tests for the iid limit; finite relative-entropy variance for the √n term	DHε(ρ‖ρ)=−ln(1−ε) in the unnormalized convention used here	nD+√(nV) Φ−1(ε)+O(ln n) only under the stated regularity conditions	A blind detector, correlated repetitions, singular support, or a moving cutoff changes or destroys the claimed rate
Bounded-observable bias ‖ω−φ‖	Normal states on one observable algebra	Predual norm; trace norm in a type-I realization	Intrinsic to the chosen detector algebra; restriction can only contract it	Optimal equal-prior one-shot state discrimination	All allowed effects belong to the declared algebra; priors and measurement class are fixed	Identical restricted states give success probability 1/2	psucc*=1/2+‖ω−φ‖/4 and 0≤‖ω−φ‖≤2	An orthogonal ultraviolet mode outside the detector algebra can be globally decisive while leaving the restricted bias zero
Root fidelity F	States on one C* algebra; trace formula only in a type-I representation	Algebraic transition probability; Bures or purified-distance topology after fixing the square convention	Common-algebra target; finite-cutoff overlap needs an independently controlled limit	Symmetric closeness and finite-copy discrimination bounds	Root convention F=‖√ρ√σ‖1; do not import formulas written for F2 without translating	F=1 exactly for equal states; F=0 for orthogonal supports	1−F≤T≤√(1−F2)	Squaring the wrong convention changes exponents; orthogonal global states can restrict to identical local states
Chernoff coefficient Q and exponent ξQCB	Finite-dimensional density operators for the theorem stated here; trace-class coefficients require their own operational limit theorem	Noncommutative s-overlap Tr ρsσ1−s	Copy model and measurement class fixed; occupation and mode cutoffs are removed only in a justified order	Optimal symmetric iid discrimination exponent	Independent copies, fixed nonzero priors, and unrestricted collective measurements	If at least one state is pure, infs Qs=F2; Q1/2 is not generally F	lim −ln pe,n*/n=−ln inf0<s<1 Qs under those hypotheses	Assuming s=1/2, using correlated copies, or interchanging copy and regulator limits can give the wrong exponent
Mutual information I(A:B)	A joint state on commuting region algebras with a defined product reference	Relative entropy to the product state	Can be intrinsic for suitably separated regions; touching regions require a common ultraviolet prescription	Total correlations visible to the two chosen algebras	Region algebras, product reference, state restriction, and separation are fixed	I=0 exactly for a product state when the comparison is defined	Positivity and Pinsker-type bounds control bounded connected correlations	Mutual information is not automatically distillable entanglement, and finiteness can fail as the separation closes
Conditional mutual information I(A:C|B)	A compatible ordered tripartite system or an explicitly applicable algebraic extension	Entropy difference; equivalently tied to recovery fidelity by theorem-specific bounds	All four entropies use one state, regulator, center choice, and region prescription	Residual A–C correlation when B is retained	The subsystem order and recovery direction are fixed; finite-dimensional statements are not silently exported to type-III factors	I=0 exactly characterizes a quantum Markov chain in finite dimensions	I≥−2 ln F(ρ, recovered ρ) for an appropriate recovery channel	Small I does not make the recovery local, causal, unique, energy bounded, or dynamically Markovian
Petz and universal recovery	A state pair, reference state, and channel between fixed operator algebras	Relative-entropy loss measured against fidelity or another stated recovery metric	Supports, modular powers, inverses, and continuum domains need explicit control	Reconstruct information lost through a channel or restriction	Normal completely positive channel, declared adjoint, reference state, and theorem-specific support conditions	Equality in data processing is equivalent to exact recovery of the specified pair under the standard hypotheses	Rotated or universal maps give quantitative fidelity bounds for nonzero information loss	An abstract recovery map need not be unique, local, causal, implementable, or finite energy
Energy-constrained diamond norm ‖Φ−Ψ‖⋄,E	Normal channels tested on input–ancilla states obeying a stated mean-energy constraint	Trace norm optimized on an energy set; weaker than the unconstrained diamond norm	Input Hamiltonian, budget E, ancilla, and cutoff remain explicit	Single-use channel discrimination with physically admissible probes	Same Hamiltonian and energy set for both channels; allowed ancillary resources are declared	Equal channels give zero; perfectly distinguishable admissible outputs attain two	psucc*=1/2+‖Φ−Ψ‖⋄,E/4 and the norm is monotone in E	Distinct pure-loss channels have unconstrained diamond distance two even when low-energy probes see only a small difference
Entropy continuity	Finite dimension, or an infinite-dimensional energy set with suitable Gibbs spectral control	Trace-distance perturbation converted into an entropy bound	Dimension or Hamiltonian and energy budget are part of the statement	Propagate state-approximation error to an entropy error bar	For the finite-dimensional sharp bound, δ≤1−1/d; infinite-dimensional variants require a finite partition function in the relevant range	The finite-dimensional Fannes–Audenaert bound is sharp for an extremal commuting pair	|S(ρ)−S(σ)|≤δ ln(d−1)+h2(δ)	At fixed trace distance, sending weight into a growing high-energy subspace makes the entropy difference grow like δ ln d

The structured comparison (JSON) preserves every row, its assumptions, and supporting references.

Where to go next

Continue to Universal, Multipartite, and Shape-Dependent Entanglement to separate local ultraviolet terms from regulator-independent geometric information.

References

• Petz, Dénes. “Sufficient Subalgebras and the Relative Entropy of States of a von Neumann Algebra.” Communications in Mathematical Physics 105 (1986): 123–131. DOI.