Liquid Schedule Construction Algorithm: an Efficient Method for Coloring a Congestion Graph

Emin Gabrielyan

2006-08-10

Table of contents

Liquid Schedule Construction Algorithm: an Efficient Congestion Graph Coloring Method. 1

Table of contents. 1

1. Introduction. 2

1.1. Parallel transmissions in circuit-switched networks. 2

1.2. Hardware solutions. 3

1.3. Liquid scheduling - an application level solution. 4

1.4. Overview of liquid scheduling. 4

2. Applicable networks. 5

2.1. Wormhole routing. 5

2.2. Optical networks. 6

3. The liquid scheduling problem.. 9

4. Definitions. 11

5. Obtaining full simultaneities. 13

5.1. Using categories to cover subsets of full simultaneities. 13

5.2. Fission of categories into sub-categories. 14

5.3. Traversing all full simultaneities by repeated fission of categories. 15

5.4. Optimisation - identifying blank categories. 16

5.5. Retrieving full teams - identifying idle categories. 16

6. Speeding up the search for full teams. 16

6.1. Skeleton of a traffic. 17

6.2. Optimization - building full teams based on full teams of the skeleton. 17

6.3. Evaluating the reduction of the search space. 18

7. Construction of liquid schedules. 19

7.1. Definition of liquid schedule. 19

7.2. Liquid schedule basic construction algorithm.. 21

7.3. Search space reduction by considering newly emerging bottlenecks. 23

7.4. Liquid schedule construction optimization by considering only full teams. 23

8. Experimental verification. 24

8.1. Swiss-Tx cluster supercomputer and 362 test traffic patterns. 24

8.2. Real traffic throughout measurements. 27

9. Conclusions. 29

Appendix A.         Congestion graph coloring heuristic approach. 31

Appendix B.         Comparison of liquid scheduling algorithm with Mixed Integer Linear Programming  35

Appendix C.         Assembling a liquid schedule: Considering teams of the reduced traffic instead of the teams of the original traffic  36

Appendix D.         Assembling a liquid schedule: Considering full teams of the reduced traffic instead of all its teams  38

References. 39

Glossary. 42

Table of figures. 45

Workshops and papers on Liquid Scheduling problem.. 47

Links and printable formats. 47

 

The upper limit of a network’s capacity is its liquid throughput. The liquid throughput corresponds to the flow of a liquid in an equivalent network of pipes. In coarse-grained networks, the aggregate throughput of an arbitrarily scheduled collective communication may be several times lower than the maximal potential throughput of the network. In wormhole and wavelength division optical networks, there is a significant loss of performance due to congestions between simultaneous transfers sharing a common communication resource. We propose to schedule the transfers of a traffic according to a schedule yielding the liquid throughput. Such a schedule, called liquid schedule, relies on the knowledge of the underlying network topology and ensures an optimal utilization of all bottleneck links. To build a liquid schedule, we partition the traffic into time frames comprising mutually non-congesting transfers keeping all bottleneck links busy during all time frames. The search for mutually non-congesting transfers utilizing all bottleneck links is of exponential complexity. We present an efficient algorithm which non-redundantly traverses the search space. We efficiently reduce the search space without affecting the solution space. The liquid schedules for small problems (up to hundred nodes) can be found in a fraction of seconds.

1. Introduction

1.1.Parallel transmissions in circuit-switched networks

It’s been more than three decades that circuit-switched networks are being successfully replaced by their packet-switched counterparts. In early 1970’s this trend started by replacing data modems with connections to the X.25 network. Today, the entire telephony is being packetized. It is commonly admitted that with fine-grained packet-switching technology, network resources are utilized more efficiently, flows are more fluid and resilient to congestions, network management is easier and the networks can flexibly scale to large sizes.

Nevertheless, several other networking approaches still based on coarse-grained circuit-switching have been emerging. These approaches offer low latencies, which is not attainable with packet switching technology, but they are also arising due to technological limitations (in optical domain).

Examples of such networks are wormhole and cut-through switching (e.g. MYRINET, InfiniBand) and optical Wavelength Division Multiplexing (WDM). Both, in wormhole and optical switching, the number of network hops separating the end nodes has nearly no impact on the communication latency (in contrast to packet switching). As for optical networks, due to the lack of optical memory, packet switching in optical networks does today not exist at all (at least commercially).

All coarse-grained circuit-switching networks suffer from a common problem: inter-blocking of transfers and jamming of large indivisible messages occupying intersecting fractions of