Getting Started with Python’s itertools

Python is a versatile language replete with many robust libraries. Among these, itertools holds a special place. It provides numerous high-performing functions, enabling you to create iterators for efficient looping.

This article introduces you to the itertools library and covers the top five itertools methods that can make your coding tasks simpler and more efficient.

1. itertools.count()

Introduction: The itertools.count() method is an infinite iterator that produces consecutive integers, and it can start at any number you specify.

Without itertools:

def count(start=0):
    n = start
    while True:
        yield n
        n += 1

counter = count(10)
for i in range(5):
    print(next(counter))

def count(start=0):

    n = start

    while True:

        yield n

        n += 1

​

counter = count(10)

for i in range(5):

    print(next(counter))

With itertools:

import itertools

counter = itertools.count(10)
for i in range(5):
    print(next(counter))

import itertools

​

counter = itertools.count(10)

for i in range(5):

    print(next(counter))

2. itertools.cycle()

Introduction: The itertools.cycle() method returns an infinite iterator cycling through an iterable (e.g., list or string).

Without itertools:

def cycle(iterable):
    while True:
        for item in iterable:
            yield item

cycler = cycle('ABCD')
for i in range(10):
    print(next(cycler))

def cycle(iterable):

    while True:

        for item in iterable:

            yield item

​

cycler = cycle('ABCD')

for i in range(10):

    print(next(cycler))

With itertools:

import itertools

cycler = itertools.cycle('ABCD')
for i in range(10):
    print(next(cycler))

import itertools

​

cycler = itertools.cycle('ABCD')

for i in range(10):

    print(next(cycler))

3. itertools.repeat()

Introduction: The itertools.repeat() method generates an iterator producing a specified item, either infinitely or a certain number of times.

Without itertools:

def repeat(item, times=None):
    while times is None or times > 0:
        if times is not None:
            times -= 1
        yield item

repeater = repeat('Python', 4)
for value in repeater:
    print(value)

def repeat(item, times=None):

    while times is None or times > 0:

        if times is not None:

            times -= 1

        yield item

​

repeater = repeat('Python', 4)

for value in repeater:

    print(value)

With itertools:

import itertools

repeater = itertools.repeat('Python', 4)
for value in repeater:
    print(value)

import itertools

​

repeater = itertools.repeat('Python', 4)

for value in repeater:

    print(value)

4. itertools.chain()

Introduction: The itertools.chain() method takes several iterators as arguments and returns a single iterator that produces the contents of all of them as though they came from a single sequence.

Without itertools:

def chain(*iterables):
    for iterable in iterables:
        for item in iterable:
            yield item

chainer = chain('ABCD', '1234')
for value in chainer:
    print(value)

def chain(*iterables):

    for iterable in iterables:

        for item in iterable:

            yield item

​

chainer = chain('ABCD', '1234')

for value in chainer:

    print(value)

With itertools:

import itertools

chainer = itertools.chain('ABCD', '1234')
for value in chainer:
    print(value)

import itertools

​

chainer = itertools.chain('ABCD', '1234')

for value in chainer:

    print(value)

5. itertools.product()

Introduction: The itertools.product() method returns the cartesian product of the provided iterables. It is equivalent to nested for-loops.

Without itertools:

def product(*iterables):
    pools = map(tuple, iterables)
    result = [[]]
    for pool in pools:
        result = [x+[y] for x in result for y in pool]
    for prod in result:
        yield tuple(prod)

cart_product = product('AB', '12')
for value in cart_product:
    print(value)

def product(*iterables):

    pools = map(tuple, iterables)

    result = [[]]

    for pool in pools:

        result = [x+[y] for x in result for y in pool]

    for prod in result:

        yield tuple(prod)

​

cart_product = product('AB', '12')

for value in cart_product:

    print(value)

With itertools:

import itertools

cart_product = itertools.product('AB', '12')
for value in cart_product:
    print(value)

import itertools

​

cart_product = itertools.product('AB', '12')

for value in cart_product:

    print(value)

More Advanced Uses of itertools

Beyond these basic utilities, itertools provides a wide variety of more complex tools that can be very powerful when combined. These include methods for producing permutations and combinations of inputs, methods for grouping inputs in various ways, and methods for filtering inputs based on complex criteria.

For instance, you can generate all possible permutations of a list of items with itertools.permutations(), or generate all distinct combinations of a certain length with itertools.combinations().

import itertools

# Generate all permutations of a list of items
for p in itertools.permutations([1, 2, 3]):
    print(p)

# Generate all distinct combinations of a certain length
for c in itertools.combinations([1, 2, 3, 4], 2):
    print(c)

import itertools

​

# Generate all permutations of a list of items

for p in itertools.permutations([1, 2, 3]):

    print(p)

​

# Generate all distinct combinations of a certain length

for c in itertools.combinations([1, 2, 3, 4], 2):

    print(c)

Remember that itertools returns iterators instead of lists, so they can handle large inputs without consuming all of your system’s memory. They also work with infinite series, and you can chain them together to form complex data pipelines. This makes itertools a versatile and powerful tool for a wide range of programming tasks.

Happy coding with itertools!