Skip to content

Add DEIMv2 #41211

@NielsRogge

Description

@NielsRogge

Model description

It would be nice to integrate DEIMv2, a new state-of-the-art model for real-time object detection based on DINOv3. The weights are released under Apache 2.0.

Related thread: Intellindust-AI-Lab/DEIMv2#20

Open source status

  • The model implementation is available
  • The model weights are available

Provide useful links for the implementation

Code: https://github.com/Intellindust-AI-Lab/DEIMv2
Weights (on Google Drive for now): https://github.com/Intellindust-AI-Lab/DEIMv2?tab=readme-ov-file#1-model-zoo

Ideally, the AutoBackbone API can be leveraged to not having to re-implement the entire DINOv3 backbone in modular_deimv2.py and modeling_deimv2.py. See an example of how this is leveraged for DETR here.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions