训练minimax- h3的nf4模型的lora，使用adapter训练时融合lora会报错 #1642

[rank0]: Traceback (most recent call last):
[rank0]: File "/data4/hjhuang/code/DiffSynth-Studio-2.1.4/examples/minimax_h3/model_training/train.py", line 190, in
[rank0]: model = MiniMaxH3TrainingModule(
[rank0]: File "/data4/hjhuang/code/DiffSynth-Studio-2.1.4/examples/minimax_h3/model_training/train.py", line 50, in init
[rank0]: self.switch_pipe_to_training_mode(
[rank0]: File "/data4/hjhuang/code/DiffSynth-Studio-2.1.4/diffsynth/diffusion/training_module.py", line 322, in switch_pipe_to_training_mode
[rank0]: pipe.load_lora(getattr(pipe, preset_lora_model), preset_lora_path)
[rank0]: File "/data4/hjhuang/code/DiffSynth-Studio-2.1.4/diffsynth/diffusion/base_pipeline.py", line 280, in load_lora
[rank0]: lora_loader.fuse_lora_to_base_model(module, lora, alpha=alpha)
[rank0]: File "/data4/hjhuang/code/DiffSynth-Studio-2.1.4/diffsynth/utils/lora/general.py", line 67, in fuse_lora_to_base_model
[rank0]: state_dict_base["weight"] = state_dict_base["weight"].to(device=self.device, dtype=self.torch_dtype) + weight_lora
[rank0]: RuntimeError: The size of tensor a (57802752) must match the size of tensor b (21504) at non-singleton dimension 0