---
title: "AWS Glue"
description: "1 posts about AWS Glue, summarised, each linking to the original."
---

# AWS Glue
> 1 posts about AWS Glue, summarised, each linking to the original.

## Articles

### [Bulk Executor for Amazon DynamoDB, Part 2: Lessons we learned the hard way](https://yomu.fyi/post/bulk-executor-for-amazon-dynamodb-part-2-lessons-we-learned-the-hard-w.md)
- Company: [AWS](https://yomu.fyi/company/aws.md)
- Author: Jason Hunter
- Published: Oct 13, 2026
- Type: Problem & solution

The post describes design tradeoffs and workarounds encountered while building the open-source Bulk Executor tool for Amazon DynamoDB on AWS Glue. Core requirements included real-time local-script feel, scaling to hundreds of parallel workers without user infrastructure management, and easy command extensibility. AWS Glue was chosen for serverless parallelism and a built-in DynamoDB connector, but the connector simplified data types, losing distinctions like string set versus list of strings. Challenges included estimating costs for provisioned tables, handling job termination with ^C, and streaming output via CloudWatch Live Tail which samples events and delivers out-of-order. Solutions included a two-phase cost estimate for deletes, programmatic interrupt handling, writing large output to S3 with a preview, mandating point-in-time recovery for mutating commands, and using AI for testing and linting; the team also migrated from AWS Glue 4 to 5 and 6 for faster startup and 30 percent lower DPU costs.