Message queues (e.g. SQS) are inappropriate for tracking long-running tasks/workflows. This is due to the operational requirements such as:

- Checking the status of a task (queued, pending, failed, cancelled, completed) - Cancelling a queued task (or pending task if the execution environment supports it) - Re-prioritizing queued tasks - Searching for tasks based off an attribute (e.g. tag)

You really do need a database for this.

I’m reminded of classical LRU cache implementation - double linked list and a hash map that points to the list elements.

It is a queue if we squint really hard, but it allows random access and reordering. Do we have durable structures of this kind?

I can’t imagine how to shoehorn this into Kafka or SQS.

Sounds like a Celery with SQLAlchemy backend.

Canvas, celery's orchestration system, leaves a lot to be desired

We literally had a major us-east-1 incident on AWS today. Only thing we can do is sit on our butts and wait for it to end so that we can clean up. This happens every few months. I am unimpressed with the the "thousands of engineers" argument.

Even if you had deployed Kubernetes into us-east-1, you'd likely still be down during the incident

It may be worthwhile to understand where dynamic typing is helpful since this gets mentioned a lot. Python and other dynamic languages are increasingly reliant on static type checkers.

An interpreter is an optimization barrier relative to native composition.

Imagine being the dev competing game Y and seeing the changelog.

It wouldn't be surprising to find out Nvidia talks directly with game developers to give them hints as to how to optimize their games

It wouldn't be surprising at all seeing as they are even in the credits for most games.

The Neopets HTML Guide [1] remains the best beginner’s guide to Web development.

[1] https://www.neopets.com/help/html1.phtml

Ah, yes. With `<font size="1" color="red">` and `<bgsound>` you're pretty much ready to be a webmaster!

It's only missing a section on how to add a guestbook and visitor counter.

Wow, Neopets is what got me into web dev. I didn't know they had their own guides!

I‘m getting a redirect to some „Help Center“

I believe the problem is the lack of proper dependency indexing at PyPI. The SAT solvers used by poetry or pdm or uv often have to download multiple versions of the same dependencies to find a solution.

Mathematical Methods of Classical Mechanics by Arnold is a good introductory book.

The point is not to spend time frantically fixing code at 3 AM.