Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(CTransformers): add support to CTransformers #1248

Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open

feat(CTransformers): add support to CTransformers #1248

wants to merge 4 commits into from

Conversation

Aisuko
Copy link
Collaborator

@Aisuko Aisuko commented Nov 6, 2023 •
edited
Loading

Description

This PR fixes #1056

Notes for Reviewers

  • Please kindly check the demo of this PR in Kaggle
  • This PR does not test in gRPC environment the reason is I have no idea how to test it. So, please careful to review the code.
  • We do not follow any of transformer feature in CTransformers is because of https://github.com/marella/ctransformers/tree/main#-transformers it is not a stable feature until now.

Signed commits

  • Yes, I signed my commits.

@Aisuko Aisuko self-assigned this Nov 6, 2023
@Aisuko Aisuko force-pushed the feat/ctransformer branch from 67552ed to dcbf836 Compare November 6, 2023 07:47
@Aisuko Aisuko force-pushed the feat/ctransformer branch from a7d87ed to 1270c8e Compare November 7, 2023 01:11
@Aisuko
Add prediction
dc751d6 
Signed-off-by: GitHub <[email protected]>
@Aisuko Aisuko requested a review from mudler November 8, 2023 00:34
@Aisuko Aisuko marked this pull request as ready for review November 8, 2023 00:34
@Aisuko Aisuko changed the title [WIP] Add support to CTransformer Add support to CTransformer Nov 8, 2023
@Aisuko Aisuko changed the title Add support to CTransformer feat(CTransformers): add support to CTransformers Nov 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@mudler mudler Awaiting requested review from mudler

At least 1 approving review is required to merge this pull request.

Assignees

@Aisuko Aisuko

Labels
Do-not-merge new-backend
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

feat: add support to ctransformers
1 participant
@Aisuko