-
Notifications
You must be signed in to change notification settings - Fork 71
issue/634: InfiniCore 支持InfiniLM Llama模型适配 #668
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
a7767ed to
c061ab0
Compare
9df35fc to
4735a0f
Compare
Signed-off-by: Ceng23333 <[email protected]>
4735a0f to
83c9a9a
Compare
python/infinicore/nn/modules.py
Outdated
| @@ -0,0 +1,49 @@ | |||
| from __future__ import annotations | |||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
这是什么?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
整个文件是调试rope精度时加的短路脚本,可以删掉
src/infinicore/tensor/copy.cc
Outdated
| if (this->is_contiguous()) { | ||
| context::memcpyD2H(this->data(), src->data(), this->data_.memory->size()); | ||
| // Verify device is still set to source device before memcpy | ||
| Device current_device = context::getDevice(); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
你上面setdevice了为什么这里还要检查?这个函数就不需要setdevice
Signed-off-by: Ceng23333 <[email protected]>
#634