Skip to content

Conversation

@pluesclues
Copy link
Collaborator

There were errors when trying to make a reward modeling notebook and the reason why is because of the way that I loaded the particular LoRA config and the fact that I had to adapt the changes to account for PeftModelForSequenceClassification.

@danielhanchen
Copy link
Contributor

@pluesclues LGTM - I'm assuming I can merge?

@pluesclues
Copy link
Collaborator Author

Yes, I just tested it @danielhanchen thanks for the quick response! :)

@danielhanchen danielhanchen merged commit 0211bf6 into unslothai:main Jun 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants