Skip to content

[docs] training performance#44342

Open
stevhliu wants to merge 2 commits intohuggingface:mainfrom
stevhliu:training-part-4
Open

[docs] training performance#44342
stevhliu wants to merge 2 commits intohuggingface:mainfrom
stevhliu:training-part-4

Conversation

@stevhliu
Copy link
Member

  • created a new performance section divided into memory and speed optimizations
  • model memory training anatomy guide is now the more descriptive and simplified GPU memory usage doc
  • add brief loss scaling section in gradient accumulation for custom loss function users

@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@stevhliu stevhliu changed the title [docs] [docs] training performance Feb 27, 2026
@stevhliu stevhliu requested a review from SunMarc February 27, 2026 21:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants