AI Personal Learning
and practical guidance
讯飞绘镜

Hyper3D: AI-generated 3D models, high precision 3D modeling from images and text (recommended)

General Introduction

Hyper3D (Shadow Eyes Technology) is a technology company focusing on 3D modeling and asset generation, and has launched two major tools, Rodin (updated Rodin 1.5) and ChatAvatar.Rodin uses AI technology to generate high-quality 3D models from images or text, and is suitable for gaming, filmmaking, and AR/VR, etc.ChatAvatar, on the other hand ChatAvatar, on the other hand, provides services for creating highly realistic 3D face models and supports conversion from images to 3D models. These tools are designed to simplify the 3D modeling process and increase productivity for a variety of professional users.

In August 2024, at the ACM SIGGRAPH conference, the world's top computer graphics conference, Clay, a 3D native large model jointly developed by Shadow Eyes and SUSTech, was published, and was nominated for the SIGGRAPH2024 Best Paper Honor at the same time as Dresscode, a 3D clothing generation model developed by the team in the same year. Clay's proposal significantly improves the 3D generation Clay has significantly improved the quality of 3D generation, and has also become a widely recognized technology path for 3D large models in the current academic world.

After the release of Rodin 1.5, a tool based on Clay's 3D Native Large Model, it has received a lot of attention from overseas users. This is the first time that a 3D large model can be generated with such sharp edges - I'd like to call it "a sharp anomaly in the era of roundedness"! --For CAD-type industrial models and hard surface models, it has an absolute advantage, expanding the group of 3D generation users.

Hyper3D:生成高质量3D模型,-1


 

Built an entire town using Rodin-generated assets to create simple animations.

 

Existing AI routes are combined to produce high-quality CG content in an offline engine.

 

Function List

  • Rodin: Generate 3D models from 2D images or text, support multiple output formats (e.g. GLTF, FBX, OBJ).
  • ChatAvatar: Generate realistic 3D facial models based on text or images, including PBR materials.
  • Highly accurate model generation: Support for 4K textures and high polygon modeling.
  • Multi-perspective integration: Generate more complete 3D models from multiple images.
  • seamless integration: Compatible with Unity, Unreal Engine, Maya and other software.

 

Using Help

Installation and use process

Rodin's use:

  1. Register for an account: Visit Hyper3D's website, select the registration option, fill in your personal information and activate your account.
  2. log in: Log in to the Hyper3D platform using your email address and password.
  3. Select Rodin: Select Rodin Services from the homepage or product page.
  4. Upload resources::
    • imagery: Click the Upload button and select the image you want to convert into a 3D model. It is recommended to use a clear, background-free image.
    • copies: Enter a detailed text description of the features and details of the 3D model you wish to generate.
  5. Generating Models::
    • Select the quality of the model you need (e.g. basic model, 4K HD model, etc.).
    • Click the Generate button and the system will generate a 3D model based on your inputs. This process may vary depending on the complexity and detail of the model, usually ranging from a few minutes to several minutes.
  6. Download model::
    • After the model is generated, you can preview the model and make some simple edits, such as adjusting materials or angles.
    • Choose the appropriate output format (e.g. GLB, FBX) and download it locally or export it directly to supported 3D software.

ChatAvatar usage:

  1. Login account: Same as above, make sure you are logged into your Hyper3D account.
  2. Select ChatAvatar: Select the ChatAvatar tool within the platform.
  3. input data::
    • photograph: Upload the photo you want to convert into a 3D face, making sure the image is of high quality and at the right angle.
    • copies: Provide a description of the features you want your face model to have, such as skin color, expression, etc.
  4. Generate a face model::
    • Adjust the generation parameters, such as material quality, resolution, etc.
    • Click the Generate button and wait for AI processing to generate a realistic 3D face model.
  5. Preview and Adjustment::
    • After it is generated, you can rotate the model to view various angles and make some adjustments, such as the shape of the eyes and mouth.
  6. Export model::
    • Choose your favorite format to download the model or export it directly to your 3D software environment.

Tips for use

  • Image Selection: For Rodin and ChatAvatar, clarity and lighting conditions are key. Try to choose images with simple backgrounds and good lighting.
  • Text description: A detailed and specific description can significantly improve the accuracy of the generated model. For example, when describing an object, specific information such as size, material, color, etc. can be mentioned.
  • model testing: After generating the model, it is recommended to test it in your usual 3D software to make sure that the model performs in real-world applications.

With these processes and techniques, you can take full advantage of Hyper3D's technology to quickly generate and apply high-quality 3D models.

May not be reproduced without permission:Chief AI Sharing Circle " Hyper3D: AI-generated 3D models, high precision 3D modeling from images and text (recommended)
en_USEnglish