InstructMesh is a new AI tool that helps users repair and customize 3D models. It was developed by MIT CSAIL, Google, and Northeastern University.
The system combines Microsoft’s TRELLIS, which creates 3D models from text and images, with GPT-4, a large language model. This pairing allows the software to understand prompts and generate detailed designs.
Users can prompt InstructMesh to create objects like mugs, glasses, or robots. They can then highlight parts of the design to refine before printing. The software makes editing easy for both experts and beginners.
Researchers tested InstructMesh by recreating models from Thingiverse. About 80% of these models had flaws. Users could identify and fix most issues, showing the tool’s effectiveness.
The team envisions future uses, such as integrating InstructMesh into augmented reality platforms. This could allow rapid 3D printing of objects based on real-world context.
InstructMesh aims to make 3D design more accessible and practical. It could also include physics simulations to test how designs react to use, like dropping or stress.
Why it matters
This software improves the quality and usability of AI-generated models, saving time and reducing errors in 3D printing.
What to do
Try using InstructMesh for your 3D projects. Use natural language prompts and refine designs with sliders for better results.
Source: https://news.mit.edu/2026/instructmesh-tool-lets-users-repair-ai-3d-models-then-fabricate-them-1001