Issues

• README quickstart text does not match its Qwen example

  huggingface/peft#4140 · Filter by author AnandaRimal opened on Nov 9, 2026
  1

• LoRA merge delta scaling allocates a second full-size tensor

  huggingface/peft#4138 · Filter by author Hang-get opened on Nov 9, 2026
  3

• add_weighted_adapter silently drops source layers when targeting filters differ (LoRA and IA3)

  huggingface/peft#4133 · Filter by author Ovi-Poddar opened on Nov 8, 2026
  2

• FSDP checkpoint resume deadlocks across ranks during distributed optimizer state sync (Llama-405B, 8x H200)

  huggingface/peft#4132 · Filter by author utkarshxdev opened on Nov 7, 2026

• Warn when LoRA SFT trains on special tokens whose input embedding is all zero (silent failure on Qwen2.5-Coder tool calls)

  huggingface/peft#4130 · Filter by author euisuh opened on Nov 6, 2026
  2

• load_adapter leaves a selectable adapter after a safetensors read failure

  huggingface/peft#4127 · Filter by author Max-Reisinger opened on Nov 6, 2026
  1

• RandLoRA: wrong matrix multiplication in 8-bit/4-bit get_delta_weight() and broken multi-adapter rank handling

  huggingface/peft#4125 · Filter by author apuravmanhas opened on Nov 5, 2026
  5

• IA3 feedforward_modules=['fc'] also marks modules like not_fc as feedforward

  huggingface/peft#4118 · Filter by author mengchen-atx opened on Nov 5, 2026
  3

• LoHa rank_dropout can produce NaN when the keep-mask is all zeros

  huggingface/peft#4117 · Filter by author mengchen-atx opened on Nov 5, 2026
  2

• BOFT on MPS: safe_merge raises LinAlgError instead of ValueError when the adapter has a NaN

  huggingface/peft#4116 · Filter by author Alex-Wengg opened on Nov 4, 2026
  8

• C3ALinear.forward chains multiple active adapters through x instead of summing them

  huggingface/peft#4115 · Filter by author vineethsaivs opened on Nov 4, 2026
  1

• Add Context Tuning as a new PEFT method, recently presented at ICML 2026

  huggingface/peft#4113 · Filter by author Jacklu0831 opened on Nov 4, 2026

• VeRA and PVeRA fail in forward() and merge() when adding a second adapter with a lower rank

  huggingface/peft#4109 · Filter by author apuravmanhas opened on Nov 3, 2026
  1

• Proposal: Add RAPA — Recursively Aligned Pathway Adaptation

  huggingface/peft#4106 · Filter by author freeSoul-SNU opened on Nov 3, 2026
  3

• Update FSDP docs

  huggingface/peft#4096 · Filter by author BenjaminBossan opened on Nov 2, 2026
  2

• layers_to_transform without layers_pattern matches nothing when the layer list is at the model root

  huggingface/peft#4090 · Filter by author udsy19 opened on Oct 31, 2026
  8

• [v1 #4071] Disjoint auxiliary trainable tokens activate only the first adapter

  huggingface/peft#4088 · Filter by author DaoyuanLi2816 opened on Oct 31, 2026
  1

• add_weighted_adapter(combination_type="svd"): exact factorized SVD instead of decomposing the dense delta

  huggingface/peft#4079 · Filter by author jontb opened on Oct 29, 2026
  3

• Error message for unmatched target_modules does not reveal that patterns are matched with re.fullmatch

  huggingface/peft#4067 · Filter by author jwh-yf opened on Oct 28, 2026
  4

• Mixed models: merge_adapter() merges nested adapters in reverse order, unmerge_adapter() then corrupts base weights

  huggingface/peft#4048 · Filter by author ATW117 opened on Oct 24, 2026
  5

• Cache the frozen LoRA-FA preconditioner to avoid repeated pseudoinverses

  huggingface/peft#4041 · Filter by author gorkadabo1 opened on Oct 23, 2026
  5

• LoRA-FA skips active adapter updates when a second adapter is present

  huggingface/peft#4039 · Filter by author cjwystz opened on Oct 23, 2026
  2

• [Feature Proposal] S-Dory-DoRA: Sparse Latent-Recurrent Directional Adaptation with QR Null-Space Guard

  huggingface/peft#4037 · Filter by author navadeep-9849 opened on Oct 23, 2026

• Loading an adapter from a Hub subfolder fails offline and with AutoPeftModel*

  huggingface/peft#4035 · Filter by author superdiaodiao opened on Oct 22, 2026
  2

• Prompt tuning: batched generate output depends on left padding

  huggingface/peft#4033 · Filter by author tivris opened on Oct 22, 2026
  3