Overview

Welcome to the SMU O’Donnell Data Science and Research Computing Institute (ODSRCI) workshop on distributed Python computing! This workshop is designed for researchers seeking to optimize their workflows for large-scale data processing and parallel computing. Participants will explore the fundamentals of distributed computing with Python, learning how to leverage Dask for efficient task parallelism and Ray for scalable machine learning and reinforcement learning applications. Through hands-on exercises, attendees will gain practical experience in deploying these tools to handle massive datasets, optimize computational resources, and streamline workflows.

Materials

• ODSRCI Workshop: Distributed Python

• ODSRCI Workshop: Distributed Python Repo

• Dask

• Ray

Fig. 1 QR code for Distributed Python workshop website.

Table of Contents

• Parallel Programming
• Environment Setup
• Dask
• Ray