I’m picking back up the work that I started last year building 3D scenes and sketches with Three.JS.
At that time, it was just after AI image generators like DALL-E and Stable Diffusion were really taking off. I had success running Stable Diffusion locally and using it to generate textures for terrain, buildings, and other environments in the 3D worlds I was building.
I was using Stable Diffusion v1 back then. I had found some prompts that I liked which created images with styles kind of like this:

Casey Primozic

A hands-on workflow for generating 4K PBR textures using Stable Diffusion XL, covering installation on an AMD 7900 XTX GPU with ROCm, prompt crafting, parameter tuning via the AUTOMATIC1111 WebUI, and a custom browser-based seamless texture stitching tool that combines four 1K tiling images into a 4K output. The post also covers converting results into full PBR maps (normal, height, AO, metalness, roughness) using the Poly AI tool, and mentions hex tiling for infinite non-repeating terrain in Three.JS.

Generating 4K PBR Textures Using Stable Diffusion XL

Stable Diffusion XL v1.0 PBR Texture Generation Workflow ⌗