Workshop on Discrepancy Theory and Integer Programming
CWI, Amsterdam - Monday June 11 - Friday June 15, 2018
Purpose:
Discrepancy theory has developed a general theory of "rounding", which allows
us to understand how much "error" one must incur to round continuous solutions
to discrete ones. This theory was by and large non-constructive until recently,
where in the last few years polynomial time algorithms have been developed that
match almost all known existential guarantees. The need for good generic
rounding methods has been clear for a long time in the context of Integer
Programming. Heuristic techniques for rounding LP solutions within MIP solvers
have been studied since at least the 1980's. The goal of this workshop is to
bring together experts in discrepancy theory and integer programming to explore
these exciting connections between both areas.
Resources and Open Problems:
A list of basic references in both discrepancy theory and rounding heuristics in
IP has been compiled here.
An evolving list of open problems in both areas is available here.
Additional suggestions for both references and open problems are welcome!
Please send your recommendations to Daniel Dadush (dndadush@gmail.com).
Registration:
Registration is free, however space is limited. Registered participants are
welcome to attend the morning talks Monday - Thursday. The work
sessions on Monday - Thursday afternoons & Friday morning are mainly
intended for invited participants. Those wishing to participate in the work sessions should express this in the registration email and commit to attending at least the first 3 days of the workshop. Please register by sending an email to
Susanne van Dam (susanne@cwi.nl) before May 25th (if possible, with
the exact dates you expect to attend) under the heading "Discrepancy and IP
workshop registration", to help us with planning and catering.
Workshop Boat Trip and Dinner (invited participants):
Date: Tuesday, June 12. Time: 6pm - late.
Leave CWI by bus at 6pm.
Boat trip 6:30pm-7:30pm (Tropen Museum to Pllek).
Dinner at Pllek 7:30pm-late.
Workshop Schedule:
Monday, June 11
Time | Location | Description |
9:30am - 10am | Outside L016 |
Coffee Break |
10:00am-11am | L016 |
Nikhil Bansal (CWI & TU/e)
A Friendly Introduction to Discrepancy Minimization
(show
abstract)
We describe the notion of discrepancy and explain its connection to
rounding fractional solutions to integral ones.
We then describe some discrepancy algorithms, and explain how they
can viewed as combining the strengths of
both iterated rounding and randomized rounding.
|
11am-12pm | L016 |
Andrea Lodi (Polytechnique Montreal)
From Pivot and Complement to the Feasibility Pump
(slides)
(show
abstract)
In this talk, I will
concentrate on the problem of finding a first feasible solution for an integer
programming problem within the branch-and-bound scheme. I will first review one
of the oldest iterative rounding heuristics for 0-1 integer programming, Pivot
and Complement by Balas & Martin (1980) and then, switch to the original version of the Feasibility Pump heuristic (Fischetti, Glover and Lodi, 2005). The latter has been followed by a number of improvements and extensions that I will highlight in short.
|
12pm-1pm |
Outside L016 |
Catered Lunch |
1pm-2pm | L016 |
Thomas Rothvoss (University of Washington)
Discrepancy Algorithms and Applications to Bin Packing
(slides)
(show
abstract)
For bin packing, the input consists of \(n\) items with sizes \(s_1,...,s_n\) in
\([0,1]\) which have to be assigned to a minimum number of bins of size 1. The
seminal Karmarkar-Karp algorithm from 1982 produces a solution with at most
\({\rm OPT} + O(\log^2 {\rm OPT})\) bins. We show that methods from discrepancy
theory can be used to find a solution of cost \({\rm OPT} + O(\log {\rm OPT})\)
in polynomial time. This is achieved by rounding a fractional solution to the
Gilmore-Gomory LP relaxation.
For the rounding algorithm itself one can use for
example the random projection algorithm that can find partial colorings even in
arbitrary symmetric convex sets.
This is joint work with Rebecca Hoberg.
|
2pm - 2:30pm |
Outside L016 |
Coffee Break |
2:30pm-3pm | L016 |
Santanu Dey (Georgia Tech)
Improving the Randomization Step in Feasibility Pump using WalkSAT
(slides)
(show
abstract)
Feasibility pump is a successful primal heuristic for mixed-integer
linear programs. The algorithm consists of three main components: rounding
fractional solution to a mixed-integer one, projection of infeasible solutions
to the Linear Programming relaxation, and a randomization step used when the
algorithm stalls. While many generalizations and improvements to the original
Feasibility Pump have been proposed, they mainly focus on the rounding and
projection steps. We start a more in-depth study of the randomization step in
Feasibility Pump. For that, we propose a new randomization step based on the
WalkSAT algorithm for solving instances of the Boolean Satisfiability Problem.
First, we provide theoretical analyses for instances with disjoint equality
constraints that show the potential of this randomization step; to the best of
our knowledge, this is the first time any theoretical analysis of running-time
of Feasibility Pump or its variants has been conducted, even for a special class
of instances. Moreover, we propose a practical version of new randomization
step, and incorporate it into a state-of-the-art Feasibility Pump code. Our
experiments suggest that this simple-to-implement modification consistently
dominates the standard randomization previously used.
This is joint work with Andres Iroume, Marco Molinaro, and Domenico Salvagnin.
|
3pm-3:30pm | L016 |
Sven Wiese (Mosek ApS)
The Feasibility Pump heuristic for Mixed Integer Conic Programming
(slides)
(show
abstract)
In Mixed Integer Conic Programming, nonlinearities are described via convex
cones. As a subclass of MINLP, it is inevitably in need of many ingredients that
make up Mixed Integer Programming, such as primal heuristics. In this talk, we
discuss some ideas on how to exploit conic structures in the Feasibility Pump
heuristic and how they can be implemented in MOSEK, a software package for
large-scale Conic and Mixed Integer Conic Programming.
|
|
3:30pm-4pm | L016 |
Open Problems Session |
4pm-4:30pm | L016 |
Coffee Break |
4:30pm - 6pm | L016, L202, L231, M290 |
Work Sessions |
Tuesday, June 12
Time | Location | Description |
9:30am - 10am | Outside L016 |
Coffee Break |
10:00am-11am | L016 |
Andrea Tramontani (IBM CPLEX) & Pietro Belotti (FICO Xpress)
Heuristics in Commercial MIP Solvers
(slides part 1)
(slides part 2)
(show
abstract)
State of the art MIP solvers offer a wide range of heuristics to provide good
quality feasible MIP solutions as early as possible during the solution process.
Whether they are used at the root node or within the branch-and-bound tree, they
can speed up the solution significantly, and they work best when they are suited
to the problem at hand or exploit its salient features.
In this joint presentation we provide a broad description of the types of
heuristics available in two commercial MIP solvers, IBM-Cplex and FICO-Xpress,
including several variants of local search and MIP-based heuristics, and discuss
how and when they are used. We also provide computational results to evaluate
the performance impact of the different types of heuristics previously
discussed.
|
11am-12pm | L016 |
Felipe Serrano (Zuse Institute Berlin)
Heuristic Algorithms in Exact MINLP Solving
(slides)
(show
abstract)
The constraint integer program framework SCIP solves convex
and nonconvex mixed-integer nonlinear programs (MINLPs) to global
optimality via spatial branch-and-bound over a linear relaxation. In
this talk we give a brief introduction to the global optimization of
MINLPs and to SCIP's solving algorithm with a special focus on primal
heuristics applied during the search.
|
12pm-1pm |
Outside L016 |
Catered Lunch |
1pm-2pm | L016 |
Friedrich Eisenbrand (École Polytechnique Fédérale de Lausanne)
Faster Algorithms for Integer Programming using the Steinitz Lemma
(show
abstract)
If the number of equations of an integer program \(\max \{c^Tx \colon Ax = b, \,
x \geq 0, x \in \mathbb{Z}^n\}\) is fixed, then the problem lends itself to
dynamic programming approaches. This was already observed in 1981 by
Papadimitriou. In this talk, we discuss how to speed up this classical dynamic
programming approach using the Steinitz Lemma which leads to the first
significant improvement of the running time since more than 30 years. We will
also discuss open problems in the area, in particular concerning integer
programming with upper bounds on the variables.
Based on joint work with Robert Weismantel.
|
2pm - 2:30pm |
Outside L016 |
Coffee Break |
2:30pm - 4:30pm | L016, L202, L231, M290 |
Work Sessions |
4pm-4:30pm | L016 |
Coffee Break |
4:30pm - 6pm | L016, L202, L231, M290 |
Work Sessions |
6pm - late | Amsterdam Canals &
Pllek |
Conference Boat Trip and Dinner |
Wednesday, June 13
Time | Location | Description |
9:30am - 10am | Outside L016 |
Coffee Break |
10am-11am | L016 |
Mohit Singh (Georgia Tech)
Iterative Rounding and its applications in Combinatorial Optimization
and Discrepancy
(show abstract)
In this talk, I will survey the iterative rounding method and illustrate its
applicability in combinatorial optimization with classical as well as new
applications. I will also talk about the close relationship between discrepancy
theory and iterative rounding.
|
11am-12am | L016 |
Rasmus Kyng (Harvard)
Fast Numerical Linear Algebra in Theoretical Computer Science
(show abstract)
I will survey some works on fast numerical linear algebra, in particular tools
for approximating matrices by sampling. We will see a simple algorithm for
sampling rows of a matrix A while approximately preserving ||Ax||_2^2 for all
vectors x. While simple and efficient algorithms can approximate ||Ax||_2^2,
more elaborate techniques can achieve the same approximation quality using fewer
row samples, and we will discuss an algorithm that reduces the sample complexity
by a factor log n.
|
12pm-1pm |
Outside L016 |
Catered Lunch |
1pm-2pm |
L016, L202, L231, M290 |
Work Sessions |
2pm - 2:30pm |
Outside L016 |
Coffee Break |
2:30pm - 4:30pm | L016, L202, L231, M290 |
Work Sessions |
4pm-4:30pm | L016 |
Coffee Break |
4:30pm - 6pm | L016, L202, L231, M290 |
Work Sessions |
Thursday, June 14
Time | Location | Description |
9:30am - 10am |
Coffee Break |
Outside L016 |
10am-11am | L016 |
Aleksandar Nikolov (University of Toronto)
Balancing Vectors in any Norm
(slides)
(show
abstract)
In the vector balancing problem, we are given symmetric convex bodies \(C\) and
\(K\) in \(n\)-dimensional space, and our goal is to determine the minimum
number \(b\), known as the vector balancing constant from \(C\) to \(K\), such
that for any sequence of vectors in \(C\) there always exists a signed combination
of them lying inside \(bK\). This quantity goes back to a question of Dvoretzky
from 1963. Many fundamental results in discrepancy theory, such as the
Beck-Fiala theorem (Discrete Applied Mathematics, Vol 3 Issue 1, 1981),
Spencer's "six standard deviations suffice" theorem (Transactions of the
American Mathematical Society, Vol 289 Issue 2, 1985) and Banaszczyk's vector
balancing theorem (Random Structures & Algorithms, Vol 12 Issue 4, 1998)
correspond to bounds on vector balancing constants.
The above theorems have inspired much research in recent years within
theoretical computer science, from the development of efficient polynomial time
algorithms that match existential vector balancing guarantees, to their
applications in the context of approximation algorithms. In this work, we show
that all vector balancing constants admit "good" approximate characterizations,
with approximation factors depending only polylogarithmically on the dimension
\(n\). First, we show that a volumetric lower bound due to Banaszczyk is tight
within a \(O(\log n)\) factor. Second, we present a novel convex program which
encodes the "best possible way" to apply Banaszczyk's vector balancing theorem
for bounding vector balancing constants from above, and show that it is tight
within an \(O(\log^{2.5} n)\) factor. This also directly yields a corresponding
polynomial time approximation algorithm both for vector balancing constants, and
for the hereditary discrepancy of any sequence of vectors with respect to an
arbitrary norm. Our results yield the first guarantees which depend only
polylogarithmically on the dimension of the norm ball \(K\).
Based on joint work with D. Dadush, K. Talwar, and N. Tomczak-Jaegermann.
|
11am-11:30am | L016 |
Alantha Newman (Université Grenoble Alpes)
Finding Permutations with Prefix Targets
(slides)
(show
abstract)
Suppose we are given two sets of positive integers \(X\) and \(Y\), where \(X\) is
ordered and interspersed with free slots. Our goal is to assign the
elements in \(Y\) to these slots so as to minimize the maximum absolute
value between the \(X\) and \(Y\) values over all prefixes. This problem is
equivalent to the so-called "Gasoline Problem". We present an
algorithm for this problem that rounds a natural LP relaxation to
produce a permutation of \(Y\) whose objective value is at most twice
optimal. We also discuss some connections to bin packing algorithms.
Based on joint work with Heiko Roeglin and Johanna Seif.
|
11:30am-12pm | L016 |
Rebecca Hoberg (University of Washington)
A Fourier-Analytic approach for Random Set Systems
(slides)
(show
abstract)
Suppose one has \(n\) elements and \(m\) sets containing each element
independently with probability \(p\). We prove that in the regime of \(n \geq
\Theta(m^2\log(m))\), the discrepancy is at most \(1\) with high probability.
Previously, a result of Ezra and Lovett gave a bound of \(O(1)\) under much
stricter assumptions.
We argue that a good coloring exists by analyzing the Fourier coefficients of
the discrepancy of a random coloring. We hope that these techniques can be
extended to a more general class of set systems.
Based on joint work with Thomas Rothvoss.
|
12pm-1pm |
Catered Lunch |
Outside L016 |
1pm - 1:30pm |
L016 |
Ambros Gleixner (Zuse Institute Berlin)
Diving for Conflicts in Mixed-Integer Programming
(slides)
(show
abstract)
We are concerned with classical diving heuristics in mixed-integer
programming solvers that iteratively fix integer variables and re-solve
the linear programming relaxation. These heuristics share the property
that they either succeed in producing a feasible primal solution or
return a dual certificate of infeasibility subject to the variable
fixings. Although aimed at success, the failure certificates can be
analyzed to extract globally valid inequalities that help to reduce the
size of the remaining search tree. We give a quick introduction to
techniques from conflict analysis and discuss the design of a diving
heuristic that aims at producing strong conflicts.
|
2pm - 2:30pm |
Outside L016 |
Coffee Break |
2:30pm - 4pm |
L016, L202, L231, M290 |
Work Sessions |
4pm - 4:30pm |
Outside L016 |
Coffee Break |
4:30pm - 6pm |
L016, L202, L231, M290 |
Work Sessions |
Friday, June 15
Time | Location | Description |
9:30am - 10am |
Outside M290 |
Coffee Break |
10:00am - 12pm |
L202, L231, M290 |
Work Sessions |
12pm-1pm |
Outside M290 |
Catered Lunch |
|
End of workshop |
|
Location
CWI, Science Park 123, 1098 XG Amsterdam. Directions can be found here.
Invited Participants
- Pietro Belotti (FICO Xpress)
- Santanu Dey (Georgia Tech)
- Fritz Eisenbrand (École Polytechnique Fédérale de Lausanne)
- Ambros Gleixner (Zuse Institute Berlin)
- Rebecca Hoberg (University of Washington)
- Rasmus Kyng (Harvard)
- Alantha Newman (Université Grenoble Alpes)
- Aleksandar Nikolov (University of Toronto)
- Thomas Rothvoss (University of Washington)
- Felipe Serrano (Zuse Institute Berlin)
- Mohit Singh (Georgia Tech)
- Andrea Tramontani (IBM CPLEX)
- Sven Wiese (Mosek ApS)
Organizers
Nikhil Bansal (CWI & TU/e), Daniel Dadush (CWI), Andrea Lodi
(Polytechnique Montreal)
NWO Veni Project : New Frontiers in Lattice Algorithms and Design.
ERC Consolidator Grant: Algorithms for Coping with Uncertainty and
Intractability.
Sponsors
|