← Back to Projects A Novel Approach to 3D Modeling: Paint Detailed 3D Objects with Image/Text Diffusion Models
3D creation workflow combining diffusion guidance and modern 3D representations for textured outputs.
Categories
GenAICV
Tech Used
Stable DiffusionDiffusersControlNetLoRADreamFusion (SDS)NeRF/Instant-NGPHugging Face TransformersTripoSRPyTorch3DOpen3DBlendertrimeshCUDAONNXTensorRTThree.jsWebGL/WebGPUFastAPIGradio
Problem
Creating detailed textured 3D assets is slow; users want guided creation from text/images.
Approach
- Used diffusion guidance (ControlNet/LoRA) for detail generation
- Explored NeRF/Instant-NGP/Gaussian Splatting for 3D representation
- Integrated pipeline into an API/UI prototype
Results
- Faster ideation for 3D assets
- Pipeline-ready components for experimentation
Screenshots
