I recently finished a big blog post about growing sparse computational graphs with RNNs.
An important part of that work involved creating a custom RNN architecture to facilitate the growth of extremely sparse networks. To help explain that custom RNN architecture in the blog post, I created some visualizations that looked like this:
These images are SVGs, so they scale infinitely without getting pixelated or blurry. I looked into a few different options for generating these including tools like draw.io, manually drawing them in a vector editor like Inkscape, and Graphviz.

Casey Primozic

A walkthrough of using TikZ (a LaTeX-based vector graphics toolkit) to create custom RNN architecture diagrams as scalable SVGs. Covers node and edge creation, relative positioning, coordinate-based edge routing, and styling — comparing TikZ favorably against Graphviz and manual Inkscape approaches for fine-grained layout control.

Building RNN Architecture Visualizations With TikZ