Chaim Rand – Medium

Chaim Rand
in
Towards Data Science

A Priority Based Scheduler for Amazon SageMaker Training Jobs

Optimizing the use of limited AI training accelerators — Part 2

12 min readMar 8, 2024

--

A Priority Based Scheduler for Amazon SageMaker Training Jobs

--

Chaim Rand

Retaining Amazon SageMaker Instance Capacity with SageMaker Managed Warm Pools

An Alternative Solution to Cloud Instance Reservation

4 min readFeb 27, 2024

--

Retaining Amazon SageMaker Instance Capacity with SageMaker Managed Warm Pools

--

Chaim Rand
in
Towards Data Science

Maximizing the Utility of Scarce AI Resources: A Kubernetes Approach

Optimizing the use of limited AI training accelerators

13 min readFeb 13, 2024

--

1

Maximizing the Utility of Scarce AI Resources: A Kubernetes Approach

--

1

Chaim Rand
in
Towards Data Science

How to Implement a Custom Training Solution Based on Amazon EC2

A Simple Solution for Managing Cloud-Based ML-Training — Part 2

11 min readJan 30, 2024

--

1

How to Implement a Custom Training Solution Based on Amazon EC2

--

1

Chaim Rand
in
Towards Data Science

Optimizing Instance Type Selection for AI Development in Cloud Spot Markets

Instance Selection for Deep Learning — Part 2

9 min readJan 22, 2024

--

Optimizing Instance Type Selection for AI Development in Cloud Spot Markets

--

Chaim Rand
in
Towards Data Science

Debugging and Tuning Amazon SageMaker Training Jobs with SageMaker SSH Helper

A new tool that increases the debuggability of managed training workloads

10 min readDec 27, 2023

--

1

Debugging and Tuning Amazon SageMaker Training Jobs with SageMaker SSH Helper

--

1

Chaim Rand
in
Towards Data Science

A Simple Solution for Managing Cloud-Based ML-Training

How to Implement a Custom Training Solution Using Basic (Unmanaged) Cloud Service APIs

18 min readDec 21, 2023

--

A Simple Solution for Managing Cloud-Based ML-Training

--

Chaim Rand
in
Towards Data Science

Using Server-less Functions to Govern and Monitor Cloud-Based Training Experiments

A simple routine that can save you loads of money

11 min readDec 17, 2023

--

Using Server-less Functions to Govern and Monitor Cloud-Based Training Experiments

--

Chaim Rand
in
Towards Data Science

Managing Your Cloud-Based Data Storage with Rclone

How to optimize data transfer across multiple object storage systems

7 min readNov 22, 2023

--

Managing Your Cloud-Based Data Storage with Rclone

--

Chaim Rand
in
Towards Data Science

Accelerating PyTorch Training Workloads with FP8

How to make the most of your modern-day GPU

8 min readNov 15, 2023

--

1

Accelerating PyTorch Training Workloads with FP8

--

1

Chaim Rand

Chaim Rand

I am a Machine Learning Algorithm Developer working on Autonomous Vehicle technologies at Mobileye. The views expressed in my posts are my own.

Help
Status
About
Careers
Blog
Privacy
Terms
Text to speech
Teams