LiquidBook Development

Enhance Your Art with Stable Diffusion and Scribble ControlNet: Haunted Mansion Edition

Ever wondered how a simple scribble can transform into a detailed, atmospheric image of a haunted mansion? Here’s a fascinating glimpse into the creative process using AI tools!

Step 1: The Scribble

It all started with a quick sketch. Using a stylus and tablet, I drew a rough outline of a mansion. This black-and-white scribble, created on my PC, served as the foundational guide for the final image.

black and white scribble illustratioin

Step 2: Enter Scribble ControlNet

To bring my sketch to life, I used Scribble ControlNet, an AI tool that helps turn simple drawings into more complex and detailed images. This tool understands the basic structure from the scribble and uses it as a blueprint for the final artwork.

Step 3: Setting the Scene with Stable Diffusion

Next, I employed the Stable Diffusion Forge UI, a powerful interface for generating images with AI. Here are the two prompts used for creating different versions of the haunted mansion:

First Image: Dark and Brooding Mansion

  • Prompt: “Scary mansion on a hill, Grimdark painting art style, dark and brooding composition, dramatic lighting, captures the sinister and macabre atmosphere.”
  • Negative Prompt: To avoid unwanted elements, I included a negative prompt: “Signature, watermark, photo, photorealistic, realism, ugly, off-center, deformed, 35mm film, dslr, cropped, frame, worst quality, low quality, lowres, JPEG artifacts.”

Second Image: Whimsical Game Art Mansion

  • Prompt: “Scary mansion on a hill, Game art illustration style, game illustration, diverse and immersive visuals, whimsical, dynamic characters and environments, rich color palettes, enhances storytelling and gameplay experience.”
  • Negative Prompt: Similar negative prompt to ensure a clean and focused output.

Step 4: Fine-Tuning the Parameters

I fine-tuned various parameters to achieve the desired effect for both images:

  • Steps: 35
  • Sampler: DPM++ 2M Karras
  • CFG Scale: 6.5
  • Seed: 3606935533
  • Size: 1024×1024
  • Model: albedobaseXL_v13 with a denoising strength of 0.7
  • ControlNet Settings: Adjusted to balance the influence of the original scribble and the AI’s creative input.

Step 5: The Magic Happens

With everything set, I ran the AI model. The results were stunning images of haunted mansions, each with a unique atmosphere and style. The AI captured the essence of both prompts perfectly, transforming the simple scribble into works of art.

Dark and Brooding Mansion: The first image has a spooky graveyard, dramatic lighting, and a dark, brooding atmosphere, perfect for a horror story setting.

Whimsical Game Art Mansion: The second image features a more whimsical and colorful style, making it ideal for a game illustration, complete with a vibrant and immersive environment.

The Final Images

The final images are a testament to the power of AI in art and design. They combine human creativity with advanced technology to produce something truly unique and captivating. Whether you’re an artist, a tech enthusiast, or just someone who loves a good spooky scene, this process showcases the incredible possibilities at the intersection of art and AI.

Social Sharing
1655-scary-mansion-on-a-hill-Grimdark-painti-stableDiffusion3SD3_sd3Medium-2128531760
scary mansion on a hill, Grimdark painting art style, dark and brooding composition, dramatic lighting, captures the ...
basset-hound-detective
A basset hound detective wearing a classic Sherlock Holmes-style outfit, complete with a deerstalker hat and a tiny, ...
DALL·E 2024-06-14 18.04.29 - A basset hound detective wearing a Victorian-era detective outfit, complete with a deerstalker hat and a tiny, tailored trench coat. The basset hound
A basset hound detective wearing a Victorian-era detective outfit outfit, complete with a deerstalker hat and a tiny,...
scary_mansion_on_a_hill
scary mansion on a hill, Grimdark painting art style, dark and brooding composition, dramatic lighting, captures the ...

This website stores cookie on your computer. These cookies are used to collect information about how you interact with our website and allow us to remember you. We use this information to improve and customize your browsing experience and for analytics and metrics about our visitors both on this website and other media. To find out more about the cookies we use, see our Privacy Policy.