Documentation

Complexity.Probability.LocalLemma

The Lovász Local Lemma #

Let A i be finitely many events in a probability space, and let Γ i be a set of indices such that A i is (lopsidedly) independent of the events outside Γ i ∪ {i}: for every set s of indices avoiding Γ i and i, the probability that A i occurs while no A j with j ∈ s occurs is at most μ (A i) times the probability that no A j with j ∈ s occurs. This holds with equality when A i is mutually independent of the events A j with j ∉ Γ i ∪ {i}, so Γ may be the neighborhood map of a dependency graph Alon and Spencer, Section 5.1; the inequality is the lopsided condition of Erdős and Spencer [ES91].

The proof shows, by strong induction on s, that μ (A i ∩ ⋂ j ∈ s, (A j)ᶜ) is at most x i * μ (⋂ j ∈ s, (A j)ᶜ) for i ∉ s; no conditional probabilities or divisions appear.

In a finite product space Cslib.Probability.PMF.pi p, events depending on disjoint sets of coordinates (Mathlib's DependsOn) are independent (Cslib.Probability.PMF.toOuterMeasure_pi_inter_eq_mul, the PMF form of ProbabilityTheory.indepSet_pi_of_dependsOn). So if each event A i depends only on the coordinates in a set vbl i, the events sharing no coordinate with A i satisfy the hypothesis, giving the variable version of the local lemma used for satisfiability and coloring problems (Cslib.Probability.PMF.prod_one_sub_le_pi_iInter_compl, Cslib.Probability.PMF.pi_iInter_compl_pos) [MT10].

Main results #

References #

theorem Cslib.Probability.prod_one_sub_le_measureReal_iInter_compl {Ω : Type u_1} {ι : Type u_2} [MeasurableSpace Ω] {μ : MeasureTheory.Measure Ω} [MeasureTheory.IsProbabilityMeasure μ] {A : ι → Set Ω} [Fintype ι] (hA : ∀ (i : ι), MeasurableSet (A i)) (Γ : ι → Finset ι) (hΓ : ∀ (i : ι) (s : Finset ι), i ∉ s → Disjoint s (Γ i) → μ.real (A i ∩ ⋂ j ∈ s, (A j)ᶜ) ≤ μ.real (A i) * μ.real (⋂ j ∈ s, (A j)ᶜ)) (x : ι → ℝ) (hx : ∀ (i : ι), x i ∈ Set.Icc 0 1) (hAx : ∀ (i : ι), μ.real (A i) ≤ x i * ∏ j ∈ Γ i, (1 - x j)) :
∏ i : ι, (1 - x i) ≤ μ.real (⋂ (i : ι), (A i)ᶜ)

The Lovász Local Lemma, asymmetric and lopsided form [Alon and Spencer, Lemma 5.1.1] [AS16], [ES91]: let A i be finitely many measurable events and let Γ i be sets of indices such that A i is lopsidedly independent of the events outside Γ i ∪ {i}. If x i ∈ [0, 1] and μ (A i) ≤ x i ∏ j ∈ Γ i, (1 - x j) for every i, then no event occurs with probability at least ∏ i, (1 - x i), which is positive when every x i < 1.

theorem Cslib.Probability.pow_le_measureReal_iInter_compl {Ω : Type u_1} {ι : Type u_2} [MeasurableSpace Ω] {μ : MeasureTheory.Measure Ω} [MeasureTheory.IsProbabilityMeasure μ] {A : ι → Set Ω} [Fintype ι] (hA : ∀ (i : ι), MeasurableSet (A i)) (Γ : ι → Finset ι) (hΓ : ∀ (i : ι) (s : Finset ι), i ∉ s → Disjoint s (Γ i) → μ.real (A i ∩ ⋂ j ∈ s, (A j)ᶜ) ≤ μ.real (A i) * μ.real (⋂ j ∈ s, (A j)ᶜ)) {d : ℕ} (hd : ∀ (i : ι), (Γ i).card ≤ d) {q : ℝ} (hq : ∀ (i : ι), μ.real (A i) ≤ q) (hlll : Real.exp 1 * q * (↑d + 1) ≤ 1) :
(↑d / (↑d + 1)) ^ Fintype.card ι ≤ μ.real (⋂ (i : ι), (A i)ᶜ)

The symmetric Lovász Local Lemma, quantitative form: if each of n measurable events has probability at most q, each A i is lopsidedly independent of the events outside Γ i ∪ {i}, each Γ i has at most d elements, and e q (d + 1) ≤ 1, then no event occurs with probability at least (d / (d + 1)) ^ n. This is positive when d ≥ 1.

theorem Cslib.Probability.measureReal_iInter_compl_pos {Ω : Type u_1} {ι : Type u_2} [MeasurableSpace Ω] {μ : MeasureTheory.Measure Ω} [MeasureTheory.IsProbabilityMeasure μ] {A : ι → Set Ω} [Finite ι] (hA : ∀ (i : ι), MeasurableSet (A i)) (Γ : ι → Finset ι) (hΓ : ∀ (i : ι) (s : Finset ι), i ∉ s → Disjoint s (Γ i) → μ.real (A i ∩ ⋂ j ∈ s, (A j)ᶜ) ≤ μ.real (A i) * μ.real (⋂ j ∈ s, (A j)ᶜ)) {d : ℕ} (hd : ∀ (i : ι), (Γ i).card ≤ d) {q : ℝ} (hq : ∀ (i : ι), μ.real (A i) ≤ q) (hlll : Real.exp 1 * q * (↑d + 1) ≤ 1) :
0 < μ.real (⋂ (i : ι), (A i)ᶜ)

The symmetric Lovász Local Lemma Alon and Spencer, Corollary 5.1.2, [EL75]: if each of finitely many measurable events has probability at most q, each A i is lopsidedly independent of the events outside Γ i ∪ {i}, each Γ i has at most d elements, and e q (d + 1) ≤ 1, then with positive probability no event occurs.

theorem Cslib.Probability.PMF.toOuterMeasure_pi_inter_eq_mul {V : Type u_1} [Fintype V] {α : V → Type u_2} [∀ (v : V), Finite (α v)] (p : (v : V) → PMF (α v)) {S T : Set V} (hST : Disjoint S T) {E F : Set ((v : V) → α v)} (hE : DependsOn (fun (x : (i : V) → α i) => x ∈ E) S) (hF : DependsOn (fun (x : (i : V) → α i) => x ∈ F) T) :

Events on disjoint coordinates are independent: in an independent product, an event depending only on the coordinates in S and an event depending only on the coordinates in a disjoint set T are independent. This is the finite-PMF form of ProbabilityTheory.indepSet_pi_of_dependsOn.

theorem Cslib.Probability.PMF.prod_one_sub_le_pi_iInter_compl {V : Type u_1} [Fintype V] {α : V → Type u_2} [∀ (v : V), Finite (α v)] {ι : Type u_3} [Fintype ι] (p : (v : V) → PMF (α v)) (A : ι → Set ((v : V) → α v)) (vbl : ι → Finset V) (hA : ∀ (i : ι), DependsOn (fun (x : (i : V) → α i) => x ∈ A i) ↑(vbl i)) (Γ : ι → Finset ι) (hΓ : ∀ (i j : ι), j ≠ i → ¬Disjoint (vbl i) (vbl j) → j ∈ Γ i) (x : ι → ℝ) (hx : ∀ (i : ι), x i ∈ Set.Icc 0 1) (hAx : ∀ (i : ι), ((pi p).toOuterMeasure (A i)).toReal ≤ x i * ∏ j ∈ Γ i, (1 - x j)) :
∏ i : ι, (1 - x i) ≤ ((pi p).toOuterMeasure (⋂ (i : ι), (A i)ᶜ)).toReal

The Lovász Local Lemma for independent coordinates, asymmetric form: let each event A i of an independent product depend only on the coordinates in vbl i, and let Γ i contain every other index whose event shares a coordinate with A i. If x i ∈ [0, 1] and Pr[A i] ≤ x i ∏ j ∈ Γ i, (1 - x j) for every i, then no event occurs with probability at least ∏ i, (1 - x i).

theorem Cslib.Probability.PMF.pi_iInter_compl_pos {V : Type u_1} [Fintype V] {α : V → Type u_2} [∀ (v : V), Finite (α v)] {ι : Type u_3} [Fintype ι] [DecidableEq ι] [DecidableEq V] (p : (v : V) → PMF (α v)) (A : ι → Set ((v : V) → α v)) (vbl : ι → Finset V) (hA : ∀ (i : ι), DependsOn (fun (x : (i : V) → α i) => x ∈ A i) ↑(vbl i)) {d : ℕ} (hd : ∀ (i : ι), {j : ι | j ≠ i ∧ ¬Disjoint (vbl i) (vbl j)}.card ≤ d) {q : ℝ} (hq : ∀ (i : ι), ((pi p).toOuterMeasure (A i)).toReal ≤ q) (hlll : Real.exp 1 * q * (↑d + 1) ≤ 1) :
0 < ((pi p).toOuterMeasure (⋂ (i : ι), (A i)ᶜ)).toReal

The symmetric Lovász Local Lemma for independent coordinates: let each event A i of an independent product depend only on the coordinates in vbl i, let each event share coordinates with at most d other events, and let each event have probability at most q. If e q (d + 1) ≤ 1, then with positive probability no event occurs.