AI Blueprints: Populate 3D Worlds Quickly
NVIDIA AI Blueprints Simplify 3D Object Generation with Microsoft TRELLIS
This article details how NVIDIA AI Blueprints are streamlining the process of 3D object generation,specifically highlighting the integration of microsoft’s TRELLIS model. Here’s a breakdown of the key takeaways:
Key Benefits & Features:
Simplified Workflow: NVIDIA AI Blueprints pre-package proven workflows, reducing the time and technical expertise needed to set up AI-powered 3D generation.
Microsoft TRELLIS Integration: the blueprint seamlessly integrates Microsoft TRELLIS, a powerful model capable of generating detailed 3D assets from text or image prompts. This is notably useful for game design, architecture, and digital media.
Performance Boost: Using the Microsoft TRELLIS NIM microservice within the blueprint results in a 20% speed increase thanks to PyTorch optimizations. This translates to approximately 6 seconds saved per object generated on an NVIDIA GeForce RTX 5090 GPU.
Hardware compatibility: Microsoft TRELLIS NIM microservice is supported on NVIDIA GeForce RTX 50 Series and 40 series GPUs with 16GB or more of VRAM.
Easy to Use: The process is designed to be user-pleasant, allowing users to generate previews and convert them to 3D models with a few clicks.
How it Works (Step-by-Step):
- Load the blueprint: Start with the pre-configured blueprint and models.
- input a Scene Idea: Describe the desired scene using a simple text prompt (e.g.,”night market”).
- Generate Previews: The system automatically generates 20 image previews.
- Refine Objects:
Replace: Click the refresh icon to generate a new object for a specific preview.
Edit Prompt: Use the pencil icon to modify the original prompt for more control over the replacement image. Delete: Remove unwanted objects using the trash can icon.
- Convert to 3D:
Individual Conversion: Convert single images to 3D using the “->3D” icon.
Batch Conversion: Convert all previews to 3D with the “Convert all to 3D” button.
- Export to Blender: Export the generated 3D models to Blender for further refinement.
Resources:
NVIDIA Build: https://build.nvidia.com/nvidia/object-generation-3d
GitHub: https://github.com/NVIDIA-AI-Blueprints/3d-object-generation
in essence, NVIDIA AI Blueprints, combined with Microsoft TRELLIS, offer a faster, more accessible way for artists and designers to create 3D content. The pre-configured workflows and performance optimizations significantly reduce the barriers to entry for AI-powered 3D generation.