Catalogue
/
Data Analytics
/
Polars for High-Performance DataFrame Processing with Python

Polars for High-Performance DataFrame Processing with Python

A practical two day technical course for participants who are new to Polars and want to process and transform data efficiently with Python. The agenda progresses from DataFrame fundamentals and the Polars expression system through joins, aggregations, file processing, lazy execution, query optimization, and larger-than-memory workflows. The course focuses on idiomatic Polars patterns that make analytical and data engineering code fast, readable, and maintainable.

What will you learn?

You will learn how to create, transform, combine, and analyze DataFrames using Polars and its expression-based API. You will work with common analytical operations, structured and nested data, Parquet and CSV files, joins, aggregations, and reusable transformation pipelines. You will also learn how lazy execution and the query optimizer work and how to design efficient processing workflows for larger datasets.

  • Perform efficient DataFrame transformations using Polars expressions
  • Combine, aggregate, reshape, and process analytical datasets
  • Use lazy execution, query optimization, and streaming for efficient data processing
  • Build maintainable Python data workflows using Polars and columnar file formats

Requirements:

  • Technical background in software development, data engineering, analytics, data science, or a related field
  • Basic Python knowledge
  • Basic familiarity with tabular data and data processing concepts
  • Previous pandas or NumPy experience is helpful but not required

Course Outline*:

*We customize the course outline and content to your specific needs and relevant use cases.

Module 1: Polars architecture and DataFrame fundamentals

  • Understanding Polars and its columnar, multi-threaded processing model
  • Creating DataFrames and inspecting schemas, columns, and data types
  • Reading and writing CSV, Parquet, JSON, and other common formats
  • Comparing core Polars concepts with familiar pandas-style workflows

Module 2: Expressions and column transformations

  • Understanding Polars expressions and expression contexts
  • Selecting, creating, renaming, casting, and transforming columns
  • Using conditional expressions, string operations, date and time functions, and null handling
  • Combining expressions to create concise and reusable transformation logic

Module 3: Filtering, sorting, grouping, and aggregation

  • Filtering rows using expression-based conditions
  • Sorting and selecting data for analytical workflows
  • Grouping data and applying multiple aggregation expressions
  • Using window expressions for calculations within groups without collapsing rows

Module 4: Joins, reshaping, and structured data

  • Combining DataFrames with inner, left, full, semi, and anti joins
  • Understanding join keys, duplicate matches, and common join pitfalls
  • Reshaping data with pivoting, unpivoting, and related operations
  • Working with lists, structs, and nested data where appropriate

Module 5: Lazy execution and the Polars query engine

  • Comparing eager DataFrames with LazyFrames
  • Building transformation pipelines without executing each operation immediately
  • Understanding query planning and automatic optimization
  • Using collect to execute optimized queries and inspect query plans

Module 6: Efficient file and Parquet processing

  • Using scan_csv, scan_parquet, and related lazy data sources
  • Understanding projection and predicate pushdown
  • Processing partitioned and multi-file datasets efficiently
  • Writing transformed results with Parquet and streaming sink operations

Module 7: Performance optimization and larger datasets

  • Understanding how column selection, filtering, data types, and query structure affect performance
  • Avoiding unnecessary Python loops and row-by-row processing
  • Using the streaming engine for memory-efficient processing
  • Identifying situations where eager execution, lazy execution, or streaming is most appropriate

Module 8: Designing maintainable Polars workflows

  • Structuring reusable transformation functions around Polars expressions
  • Building clear pipelines from raw input through cleaning, transformation, and analytical output
  • Integrating Polars with Python applications and surrounding data processing tools
  • Building a practical checklist for correctness, performance, memory efficiency, readability, and maintainability

Hands-on learning with expert instructors at your location for organizations.

3,072€*
Graph Icon - Education X Webflow Template
Level:
intermediate
Clock Icon - Education X Webflow Template
Duration:
14
Hours (days:
2
)
Camera Icon - Education X Webflow Template
Training customized to your needs
Star Icon - Education X Webflow Template
Immersive hands-on experience in a dedicated setting
*Price can range depending on number of participants, change of outline, location etc.

Master new skills guided by experienced instructors from anywhere.

2,037€*
Graph Icon - Education X Webflow Template
Level:
intermediate
Clock Icon - Education X Webflow Template
Duration:
14
Hours (days:
2
)
Camera Icon - Education X Webflow Template
Training customized to your needs
Star Icon - Education X Webflow Template
Reduced training costs
*Price can range depending on number of participants, change of outline, location etc.

Upcoming Sessions

4-5 Feb 2027
Barcelona
24-25 Feb 2027
Milan
11-12 Mar 2027
Brussels
25-26 Mar 2027
Frankfurt
6-7 Apr 2027
Barcelona

Can't find a suitable date? Get in touch and we'll arrange one that works for you.

We use cookies to improve site navigation, analyse how the site is used, and support our marketing. You can accept all cookies, reject non-essential ones, or choose individual categories. Read our Cookie Notice